[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:32 dist-test-slave-7f01 krb5kdc[9798](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:32 dist-test-slave-7f01 krb5kdc[9798](info): set up 2 sockets
Aug 11 07:16:32 dist-test-slave-7f01 krb5kdc[9798](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 07:16:33.596159 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.433s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:33 dist-test-slave-7f01 krb5kdc[9798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:16:33.736300 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33479
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:33479
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:33.840128 9825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:33.840353 9825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:33.840376 9825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:33.841529 9825 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:33.841571 9825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:33.841585 9825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:33.841598 9825 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:33.841610 9825 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:33.843117 9825 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:33479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:33.843390 9825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:33.843626 9825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:33.848997 9837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:33.848979 9836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:33.849058 9825 server_base.cc:1034] running on GCE node
W20260811 07:16:33.849005 9841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:33.849474 9825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:33.849786 9825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:33.850939 9825 hybrid_clock.cc:648] HybridClock initialized: now 1786432593850891 us; error 65 us; skew 500 ppm
Aug 11 07:16:33 dist-test-slave-7f01 krb5kdc[9798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432593, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:33.853601 9825 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:16:33.854102 9825 webserver.cc:460] Webserver started at http://127.9.142.190:39137/ using document root <none> and password file <none>
I20260811 07:16:33.854350 9825 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:33.854398 9825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:33.854619 9825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:33.855724 9825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "068875b83de240b0ab89e5f96bda855c"
format_stamp: "Formatted at 2026-08-11 07:16:33 on dist-test-slave-7f01"
server_key: "81f54051f6ee804ef10a79c4dd1220b5"
server_key_iv: "357f5817ea679dcd54cbe56082cffd81"
server_key_version: "encryptionkey@0"
I20260811 07:16:33.856190 9825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "068875b83de240b0ab89e5f96bda855c"
format_stamp: "Formatted at 2026-08-11 07:16:33 on dist-test-slave-7f01"
server_key: "81f54051f6ee804ef10a79c4dd1220b5"
server_key_iv: "357f5817ea679dcd54cbe56082cffd81"
server_key_version: "encryptionkey@0"
I20260811 07:16:33.857633 9825 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 07:16:33.858448 9852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:33.858644 9825 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:33.858747 9825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "068875b83de240b0ab89e5f96bda855c"
format_stamp: "Formatted at 2026-08-11 07:16:33 on dist-test-slave-7f01"
server_key: "81f54051f6ee804ef10a79c4dd1220b5"
server_key_iv: "357f5817ea679dcd54cbe56082cffd81"
server_key_version: "encryptionkey@0"
I20260811 07:16:33.858817 9825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:33.885663 9825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:33.888129 9825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:33.888257 9825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:33.892921 9825 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:33479
I20260811 07:16:33.893002 9939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:33479 every 8 connection(s)
I20260811 07:16:33.893386 9825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:33.894409 9942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:33.897149 9942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c: Bootstrap starting.
I20260811 07:16:33.897837 9942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:33.898149 9942 log.cc:824] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:33.898741 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 9825
I20260811 07:16:33.898873 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:33.898990 9942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c: No bootstrap required, opened a new log
I20260811 07:16:33.899673 9786 external_mini_cluster.cc:1428] Setting key abdf6a7bdcc4aa64db2053eef7380a9f
I20260811 07:16:33.901535 9942 raft_consensus.cc:348] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068875b83de240b0ab89e5f96bda855c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33479 } }
I20260811 07:16:33.901721 9942 raft_consensus.cc:374] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:33.901762 9942 raft_consensus.cc:729] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 068875b83de240b0ab89e5f96bda855c, State: Initialized, Role: FOLLOWER
I20260811 07:16:33.901893 9942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068875b83de240b0ab89e5f96bda855c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33479 } }
I20260811 07:16:33.901983 9942 raft_consensus.cc:388] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:33.902016 9942 raft_consensus.cc:482] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:33.902072 9942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:33.903362 9942 raft_consensus.cc:504] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068875b83de240b0ab89e5f96bda855c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33479 } }
I20260811 07:16:33.903496 9942 leader_election.cc:302] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 068875b83de240b0ab89e5f96bda855c; no voters:
I20260811 07:16:33.903674 9942 leader_election.cc:288] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:33.903704 9951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:33.903906 9951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [term 1 LEADER]: Becoming Leader. State: Replica: 068875b83de240b0ab89e5f96bda855c, State: Running, Role: LEADER
I20260811 07:16:33.904019 9942 sys_catalog.cc:564] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:33.904016 9951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068875b83de240b0ab89e5f96bda855c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33479 } }
I20260811 07:16:33.905298 9956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 068875b83de240b0ab89e5f96bda855c. Latest consensus state: current_term: 1 leader_uuid: "068875b83de240b0ab89e5f96bda855c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068875b83de240b0ab89e5f96bda855c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33479 } } }
I20260811 07:16:33.905402 9956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:33.905645 9971 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:33.905768 9955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "068875b83de240b0ab89e5f96bda855c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "068875b83de240b0ab89e5f96bda855c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33479 } } }
I20260811 07:16:33.905896 9955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:33.906312 9971 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:33.908002 9971 catalog_manager.cc:1347] Generated new cluster ID: 1c683deeb9da4cc78c81ca51187ecd82
I20260811 07:16:33.908059 9971 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:16:33 dist-test-slave-7f01 krb5kdc[9798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:33.915064 9971 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:33.915804 9971 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:33.917794 9948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:33.900724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37972 (local address 127.9.142.190:33479)
0811 07:16:33.900917 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:33.900927 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:33.901190 (+ 263us) server_negotiation.cc:407] Connection header received
0811 07:16:33.904070 (+ 2880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:33.904077 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:33.904176 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:33.904408 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:33.906822 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:33.908276 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:33.909367 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:33.909880 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:33.910024 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:33.913724 (+ 3700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:33.913729 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:33.913729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:33.913748 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:33.915709 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:33.916236 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:33.916239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:33.916239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:33.916345 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:33.916617 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:33.916618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:33.916618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:33.916853 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:33.917070 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:33.917329 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 07:16:33.917476 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260811 07:16:33.922567 9971 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 068875b83de240b0ab89e5f96bda855c: Generated new TSK 0
I20260811 07:16:33.922729 9971 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:16:33.951203 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33479
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:34.038381 9998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:34.038635 9998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:34.038676 9998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:34.039915 9998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:34.039976 9998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:34.040021 9998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:16:34.042091 9998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33479
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:34.042404 9998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:34.042662 9998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:34.048192 10006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:34.048182 10008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:34.048229 10005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:34.048491 9998 server_base.cc:1034] running on GCE node
I20260811 07:16:34.048792 9998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:34.049052 9998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:34.050238 9998 hybrid_clock.cc:648] HybridClock initialized: now 1786432594050224 us; error 30 us; skew 500 ppm
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:34.053071 9998 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:16:34.053484 9998 webserver.cc:460] Webserver started at http://127.9.142.129:40739/ using document root <none> and password file <none>
I20260811 07:16:34.053738 9998 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:34.053787 9998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:34.053961 9998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:34.055075 9998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "816ebd9aaf1341f1906d8eb9ef77c50e"
format_stamp: "Formatted at 2026-08-11 07:16:34 on dist-test-slave-7f01"
server_key: "1d0366007bd00ca1d0d4af7492cd047f"
server_key_iv: "87ec5ac68b7b2baa2df1501e05fffd39"
server_key_version: "encryptionkey@0"
I20260811 07:16:34.055452 9998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "816ebd9aaf1341f1906d8eb9ef77c50e"
format_stamp: "Formatted at 2026-08-11 07:16:34 on dist-test-slave-7f01"
server_key: "1d0366007bd00ca1d0d4af7492cd047f"
server_key_iv: "87ec5ac68b7b2baa2df1501e05fffd39"
server_key_version: "encryptionkey@0"
I20260811 07:16:34.056929 9998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 07:16:34.057758 10023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:34.057987 9998 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:34.058099 9998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "816ebd9aaf1341f1906d8eb9ef77c50e"
format_stamp: "Formatted at 2026-08-11 07:16:34 on dist-test-slave-7f01"
server_key: "1d0366007bd00ca1d0d4af7492cd047f"
server_key_iv: "87ec5ac68b7b2baa2df1501e05fffd39"
server_key_version: "encryptionkey@0"
I20260811 07:16:34.058188 9998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:34.086522 9998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:34.089795 9998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:34.090011 9998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:34.090291 9998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:34.090760 9998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:34.090831 9998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:34.090867 9998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:34.090900 9998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:34.097528 9998 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:41049
I20260811 07:16:34.097589 10257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:41049 every 8 connection(s)
I20260811 07:16:34.097968 9998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:34.107601 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 9998
I20260811 07:16:34.107752 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:16:34.107956 9786 external_mini_cluster.cc:1428] Setting key 37294c2a51fa268bfafe855eb8e72e55
I20260811 07:16:34.110484 9948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:34.098774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:56899 (local address 127.9.142.190:33479)
0811 07:16:34.098842 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:34.098844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:34.099027 (+ 183us) server_negotiation.cc:407] Connection header received
0811 07:16:34.099918 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:34.099920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:34.099931 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:34.100006 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:34.101552 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.102355 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.103517 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.103883 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.103963 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:34.106729 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:34.106730 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:34.106731 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:34.106738 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:34.108771 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.109306 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.109307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.109307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.109432 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.109796 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.109797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.109797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.109921 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:34.109979 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:34.110318 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 07:16:34.110410 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:16:34.110801 10261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:34.098717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33479 (local address 127.9.142.129:56899)
0811 07:16:34.098888 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:34.098933 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:34.099655 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:34.100184 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:34.100190 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:34.101026 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:34.101261 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:34.101267 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.102484 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.102485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:34.103316 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:34.103318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.103970 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.103971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:34.104087 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:34.104832 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:34.104844 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:34.106599 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:34.108875 (+ 2276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:34.108884 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:34.108886 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:34.109223 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:34.109553 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:34.109555 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:34.109555 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:34.109724 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:34.109993 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:34.110000 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:34.110171 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 07:16:34.110289 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 07:16:34.110487 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
I20260811 07:16:34.111438 10258 heartbeater.cc:347] Connected to a master server at 127.9.142.190:33479
I20260811 07:16:34.111524 10258 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:34.111724 10258 heartbeater.cc:511] Master 127.9.142.190:33479 requested a full tablet report, sending...
I20260811 07:16:34.112406 9876 ts_manager.cc:194] Registered new tserver with Master: 816ebd9aaf1341f1906d8eb9ef77c50e (127.9.142.129:41049)
I20260811 07:16:34.113058 9876 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:56899
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:16:34.135028 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33479
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:34.218225 10265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:34.218456 10265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:34.218500 10265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:34.219627 10265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:34.219697 10265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:34.219743 10265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:16:34.221253 10265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33479
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:34.221522 10265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:34.221753 10265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:34.226821 10273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:34.226867 10274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:34.226874 10278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:34.227141 10265 server_base.cc:1034] running on GCE node
I20260811 07:16:34.227298 10265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:34.227530 10265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:34.228669 10265 hybrid_clock.cc:648] HybridClock initialized: now 1786432594228649 us; error 36 us; skew 500 ppm
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:34.231199 10265 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:16:34.231626 10265 webserver.cc:460] Webserver started at http://127.9.142.130:44957/ using document root <none> and password file <none>
I20260811 07:16:34.231971 10265 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:34.232048 10265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:34.232201 10265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:34.233209 10265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "bfa9dc34ffa4400c8eab5db343673df9"
format_stamp: "Formatted at 2026-08-11 07:16:34 on dist-test-slave-7f01"
server_key: "2f395a618682761bf9592d00cd443bdd"
server_key_iv: "f09d8b43bc4f1605d0b3b42ee4e8b76f"
server_key_version: "encryptionkey@0"
I20260811 07:16:34.233575 10265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "bfa9dc34ffa4400c8eab5db343673df9"
format_stamp: "Formatted at 2026-08-11 07:16:34 on dist-test-slave-7f01"
server_key: "2f395a618682761bf9592d00cd443bdd"
server_key_iv: "f09d8b43bc4f1605d0b3b42ee4e8b76f"
server_key_version: "encryptionkey@0"
I20260811 07:16:34.234939 10265 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:34.235652 10289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:34.235836 10265 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:34.235958 10265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "bfa9dc34ffa4400c8eab5db343673df9"
format_stamp: "Formatted at 2026-08-11 07:16:34 on dist-test-slave-7f01"
server_key: "2f395a618682761bf9592d00cd443bdd"
server_key_iv: "f09d8b43bc4f1605d0b3b42ee4e8b76f"
server_key_version: "encryptionkey@0"
I20260811 07:16:34.236034 10265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:34.264846 10265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:34.267233 10265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:34.267400 10265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:34.267642 10265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:34.268021 10265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:34.268092 10265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:34.268134 10265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:34.268163 10265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:34.275007 10265 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:38735
I20260811 07:16:34.275084 10480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:38735 every 8 connection(s)
I20260811 07:16:34.275383 10265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:16:34.279938 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 10265
I20260811 07:16:34.280035 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:16:34.280161 9786 external_mini_cluster.cc:1428] Setting key 0513704baca85c31d373072ae76e11f7
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:34.285154 10485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:34.276072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33479 (local address 127.9.142.130:50517)
0811 07:16:34.276246 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:34.276289 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:34.276795 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:34.277007 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:34.277010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:34.277564 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:34.277779 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:34.277783 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.278445 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.278445 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:34.279350 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:34.279352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.279695 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.279696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:34.279829 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:34.280372 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:34.280384 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:34.281874 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:34.283803 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:34.283810 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:34.283812 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:34.284044 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:34.284266 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:34.284267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:34.284267 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:34.284369 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:34.284669 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:34.284674 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:34.284787 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 07:16:34.284868 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 07:16:34.284991 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
I20260811 07:16:34.285157 9948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:34.276120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:50517 (local address 127.9.142.190:33479)
0811 07:16:34.276164 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:34.276166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:34.276383 (+ 217us) server_negotiation.cc:407] Connection header received
0811 07:16:34.276876 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:34.276877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:34.276887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:34.276958 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:34.277852 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.278362 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.279423 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.279620 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.279675 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:34.281979 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:34.281981 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:34.281982 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:34.281990 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:34.283674 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.284126 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.284128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.284128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.284195 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.284447 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.284448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.284448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.284603 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:34.284675 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:34.284917 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 07:16:34.285017 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:16:34.285722 10482 heartbeater.cc:347] Connected to a master server at 127.9.142.190:33479
I20260811 07:16:34.285842 10482 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:34.286034 10482 heartbeater.cc:511] Master 127.9.142.190:33479 requested a full tablet report, sending...
I20260811 07:16:34.286500 9876 ts_manager.cc:194] Registered new tserver with Master: bfa9dc34ffa4400c8eab5db343673df9 (127.9.142.130:38735)
I20260811 07:16:34.287006 9876 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:50517
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:16:34.308599 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33479
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:34.395457 10491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:34.395653 10491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:34.395677 10491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:34.396798 10491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:34.396842 10491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:34.396867 10491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:16:34.398216 10491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33479
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:34.398386 10491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:34.398552 10491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:34.403532 10502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:34.403553 10499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:34.403630 10498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:34.403888 10491 server_base.cc:1034] running on GCE node
I20260811 07:16:34.404143 10491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:34.404384 10491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:34.405511 10491 hybrid_clock.cc:648] HybridClock initialized: now 1786432594405495 us; error 36 us; skew 500 ppm
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:34.408157 10491 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:16:34.408588 10491 webserver.cc:460] Webserver started at http://127.9.142.131:45955/ using document root <none> and password file <none>
I20260811 07:16:34.408813 10491 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:34.408859 10491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:34.409008 10491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:34.410045 10491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "ae9961e11f7046b6b0c1b93b70fdf16f"
format_stamp: "Formatted at 2026-08-11 07:16:34 on dist-test-slave-7f01"
server_key: "8d134da7faaf87f109911996327c3b1a"
server_key_iv: "b87f769d623fe0f230f7648fd0cb155a"
server_key_version: "encryptionkey@0"
I20260811 07:16:34.410408 10491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "ae9961e11f7046b6b0c1b93b70fdf16f"
format_stamp: "Formatted at 2026-08-11 07:16:34 on dist-test-slave-7f01"
server_key: "8d134da7faaf87f109911996327c3b1a"
server_key_iv: "b87f769d623fe0f230f7648fd0cb155a"
server_key_version: "encryptionkey@0"
I20260811 07:16:34.411679 10491 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 07:16:34.412468 10514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:34.412632 10491 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:34.412745 10491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "ae9961e11f7046b6b0c1b93b70fdf16f"
format_stamp: "Formatted at 2026-08-11 07:16:34 on dist-test-slave-7f01"
server_key: "8d134da7faaf87f109911996327c3b1a"
server_key_iv: "b87f769d623fe0f230f7648fd0cb155a"
server_key_version: "encryptionkey@0"
I20260811 07:16:34.412825 10491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:34.420912 10491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:34.422765 10491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:34.422926 10491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:34.423192 10491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:34.423496 10491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:34.423552 10491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:34.423602 10491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:34.423629 10491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:34.430382 10491 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:39407
I20260811 07:16:34.430430 10712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:39407 every 8 connection(s)
I20260811 07:16:34.430747 10491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:16:34.433935 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 10491
I20260811 07:16:34.434048 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:16:34.434212 9786 external_mini_cluster.cc:1428] Setting key a739678dd085addb23bb33bc18561130
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:34.440233 9948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:34.431587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:48693 (local address 127.9.142.190:33479)
0811 07:16:34.431649 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:34.431651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:34.431922 (+ 271us) server_negotiation.cc:407] Connection header received
0811 07:16:34.432385 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:34.432387 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:34.432396 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:34.432460 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:34.433380 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.433917 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.435040 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.435244 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.435321 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:34.437483 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:34.437484 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:34.437485 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:34.437492 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:34.438793 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.439194 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.439196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.439196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.439263 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.439525 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.439526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.439526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.439644 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:34.439723 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:34.440063 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 07:16:34.440143 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 07:16:34.440441 10717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:34.431555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33479 (local address 127.9.142.131:48693)
0811 07:16:34.431719 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:34.431836 (+ 117us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:34.432306 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:34.432517 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:34.432520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:34.433092 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:34.433284 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:34.433289 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.434030 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.434031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:34.434932 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:34.434935 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.435332 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.435334 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:34.435474 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:34.435987 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:34.435995 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:34.437383 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:34.438872 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:34.438879 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:34.438882 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:34.439113 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:34.439332 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:34.439333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:34.439333 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:34.439446 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:34.439765 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:34.439773 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:34.439922 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 07:16:34.440038 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 07:16:34.440199 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
I20260811 07:16:34.440981 10714 heartbeater.cc:347] Connected to a master server at 127.9.142.190:33479
I20260811 07:16:34.441067 10714 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:34.441207 10714 heartbeater.cc:511] Master 127.9.142.190:33479 requested a full tablet report, sending...
I20260811 07:16:34.441578 9876 ts_manager.cc:194] Registered new tserver with Master: ae9961e11f7046b6b0c1b93b70fdf16f (127.9.142.131:39407)
I20260811 07:16:34.441972 9876 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:48693
I20260811 07:16:34.446106 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:16:34.471917 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:34.464182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48634 (local address 127.9.142.129:41049)
0811 07:16:34.464384 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:34.464390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:34.464401 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:16:34.464430 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:34.464432 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:34.464446 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:34.464516 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:34.465061 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.465790 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.466520 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.466892 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.466960 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:34.469355 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:34.469363 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:34.469363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:34.469371 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:34.470750 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.471117 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.471120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.471120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.471181 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.471355 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.471356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.471356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.471488 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:34.471615 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:34.471650 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 07:16:34.471716 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":100,"threads_started":1}
W20260811 07:16:34.472345 10072 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48634
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[9798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:16:34.497681 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:34.489822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48644 (local address 127.9.142.129:41049)
0811 07:16:34.489903 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:34.489906 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:34.489991 (+ 85us) server_negotiation.cc:407] Connection header received
0811 07:16:34.490097 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:34.490098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:34.490112 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:34.490187 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:34.490790 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.491310 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.492138 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:34.492357 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:34.492438 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:34.494925 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:34.494926 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:34.494929 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:34.494941 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:34.496414 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.496849 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.496850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.496850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.496907 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:34.497126 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:34.497127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:34.497127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:34.497236 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:34.497372 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:34.497482 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 07:16:34.497570 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:16:34.498350 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 9998
I20260811 07:16:34.513422 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 10265
I20260811 07:16:34.522298 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 10491
I20260811 07:16:34.534237 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 9825
2026-08-11T07:16:34Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2406 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[10742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[10742](info): set up 2 sockets
Aug 11 07:16:34 dist-test-slave-7f01 krb5kdc[10742](info): commencing operation
krb5kdc: starting...
W20260811 07:16:35.848791 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:35 dist-test-slave-7f01 krb5kdc[10742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:16:35.970944 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:40997
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:40997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:36.056274 10761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:36.056524 10761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:36.056561 10761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:36.057709 10761 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:36.057775 10761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:36.057801 10761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:36.057830 10761 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:36.057859 10761 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:36.059880 10761 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:40997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:40997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:36.060202 10761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:36.060457 10761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:36.066085 10768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:36.066092 10774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:36.066100 10769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:36.066133 10761 server_base.cc:1034] running on GCE node
I20260811 07:16:36.066577 10761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:36.066922 10761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:36.068132 10761 hybrid_clock.cc:648] HybridClock initialized: now 1786432596068117 us; error 45 us; skew 500 ppm
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:36.070966 10761 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:16:36.071462 10761 webserver.cc:460] Webserver started at http://127.9.142.190:41199/ using document root <none> and password file <none>
I20260811 07:16:36.071770 10761 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:36.071843 10761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:36.071997 10761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:36.073405 10761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "6c5879d73b6f3ccd6db9ae73d2b3e14d"
server_key_iv: "47060d3801c2a26511ef319a57b3973f"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.073822 10761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "6c5879d73b6f3ccd6db9ae73d2b3e14d"
server_key_iv: "47060d3801c2a26511ef319a57b3973f"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.075222 10761 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:36.076050 10783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.076256 10761 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:36.076359 10761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "6c5879d73b6f3ccd6db9ae73d2b3e14d"
server_key_iv: "47060d3801c2a26511ef319a57b3973f"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.076426 10761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:36.101506 10761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:36.104071 10761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:36.104192 10761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:36.109730 10761 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:40997
I20260811 07:16:36.109872 10876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:40997 every 8 connection(s)
I20260811 07:16:36.110194 10761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:36.111271 10877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:36.113726 10877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7: Bootstrap starting.
I20260811 07:16:36.114359 10877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:36.114782 10877 log.cc:824] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:36.115577 10877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7: No bootstrap required, opened a new log
I20260811 07:16:36.116165 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 10761
I20260811 07:16:36.116267 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:36.116447 9786 external_mini_cluster.cc:1428] Setting key 467253fd114516e747938459f899cb67
I20260811 07:16:36.117910 10877 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40997 } }
I20260811 07:16:36.118100 10877 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:36.118146 10877 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75d55d764bbf4af4b8c1e28fc3d7d2a7, State: Initialized, Role: FOLLOWER
I20260811 07:16:36.118307 10877 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40997 } }
I20260811 07:16:36.118376 10877 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:36.118398 10877 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:36.118448 10877 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:36.119625 10877 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40997 } }
I20260811 07:16:36.119757 10877 leader_election.cc:302] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75d55d764bbf4af4b8c1e28fc3d7d2a7; no voters:
I20260811 07:16:36.119925 10877 leader_election.cc:288] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:36.120003 10887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:36.120150 10887 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [term 1 LEADER]: Becoming Leader. State: Replica: 75d55d764bbf4af4b8c1e28fc3d7d2a7, State: Running, Role: LEADER
I20260811 07:16:36.120173 10877 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:36.120292 10887 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40997 } }
I20260811 07:16:36.121008 10890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40997 } } }
I20260811 07:16:36.121111 10890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:36.121501 10899 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:36.121529 10888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75d55d764bbf4af4b8c1e28fc3d7d2a7. Latest consensus state: current_term: 1 leader_uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75d55d764bbf4af4b8c1e28fc3d7d2a7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40997 } } }
I20260811 07:16:36.121842 10888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:36.122278 10899 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:36.124387 10899 catalog_manager.cc:1347] Generated new cluster ID: eeeb373524a84acf96c24ac8e04ef7a5
I20260811 07:16:36.124486 10899 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:36.129113 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.117002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54592 (local address 127.9.142.190:40997)
0811 07:16:36.117224 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.117234 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.117269 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:16:36.117871 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.117880 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.117944 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.118094 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:36.118881 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.120346 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.121561 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.122149 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.122259 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.125419 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:36.125422 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:36.125423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:36.125434 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:36.127375 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.127810 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.127813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.127813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.127952 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.128191 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.128191 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.128192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.128475 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:36.128627 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.128754 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.128914 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":98,"threads_started":1}
I20260811 07:16:36.142558 10899 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:36.143234 10899 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:36.154152 10899 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75d55d764bbf4af4b8c1e28fc3d7d2a7: Generated new TSK 0
I20260811 07:16:36.154314 10899 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:16:36.186775 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40997
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:36.273048 10917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:36.273237 10917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:36.273260 10917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:36.274312 10917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:36.274350 10917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:36.274376 10917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:16:36.275882 10917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40997
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:36.276064 10917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:36.276237 10917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:16:36.281298 10917 server_base.cc:1034] running on GCE node
W20260811 07:16:36.281279 10930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:36.281276 10928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:36.281268 10927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:36.281638 10917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:36.281929 10917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:36.283079 10917 hybrid_clock.cc:648] HybridClock initialized: now 1786432596283058 us; error 38 us; skew 500 ppm
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:36.285668 10917 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:16:36.286151 10917 webserver.cc:460] Webserver started at http://127.9.142.129:35933/ using document root <none> and password file <none>
I20260811 07:16:36.286401 10917 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:36.286474 10917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:36.286624 10917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:36.287626 10917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "23abbe0084ff40d79e1582d33f6566b0"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "1c39d83249d2d60505cae7011508f9be"
server_key_iv: "96a499652ec7af85fb40dac852406403"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.288053 10917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "23abbe0084ff40d79e1582d33f6566b0"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "1c39d83249d2d60505cae7011508f9be"
server_key_iv: "96a499652ec7af85fb40dac852406403"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.289350 10917 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:36.290081 10943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.290253 10917 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:36.290364 10917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "23abbe0084ff40d79e1582d33f6566b0"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "1c39d83249d2d60505cae7011508f9be"
server_key_iv: "96a499652ec7af85fb40dac852406403"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.290441 10917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:36.304322 10917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:36.306090 10917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:36.306255 10917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:36.306478 10917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:36.306803 10917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:36.306861 10917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.306903 10917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:36.306941 10917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.313149 10917 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:45671
I20260811 07:16:36.313190 11158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:45671 every 8 connection(s)
I20260811 07:16:36.313539 10917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:36.321807 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 10917
I20260811 07:16:36.321926 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:16:36.322145 9786 external_mini_cluster.cc:1428] Setting key 3613f21863f8fc2f2fe0cd2b3f22d394
I20260811 07:16:36.323051 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.314273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:34243 (local address 127.9.142.190:40997)
0811 07:16:36.314316 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.314318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.314516 (+ 198us) server_negotiation.cc:407] Connection header received
0811 07:16:36.315547 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.315548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.315560 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.315617 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:36.316313 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.316810 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.317767 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.317979 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.318031 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.320105 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:36.320106 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:36.320107 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:36.320115 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:36.321558 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.322044 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.322044 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.322045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.322099 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.322384 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.322385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.322386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.322533 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:36.322607 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.322895 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.322986 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:16:36.323307 11167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.314219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:40997 (local address 127.9.142.129:34243)
0811 07:16:36.314388 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:36.314430 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:36.315457 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:36.315668 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:36.315671 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:36.315993 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:36.316196 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.316201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.316898 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.316899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.317691 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.317693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.318055 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.318056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.318160 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.318651 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:36.318659 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:36.320025 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:36.321645 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:36.321654 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:36.321656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:36.321969 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:36.322166 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:36.322167 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:36.322167 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:36.322308 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:36.322606 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:36.322611 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:36.322740 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 07:16:36.322850 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 07:16:36.323044 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260811 07:16:36.323894 11164 heartbeater.cc:347] Connected to a master server at 127.9.142.190:40997
I20260811 07:16:36.323997 11164 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:36.324185 11164 heartbeater.cc:511] Master 127.9.142.190:40997 requested a full tablet report, sending...
I20260811 07:16:36.324735 10815 ts_manager.cc:194] Registered new tserver with Master: 23abbe0084ff40d79e1582d33f6566b0 (127.9.142.129:45671)
I20260811 07:16:36.325359 10815 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:34243
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:16:36.349659 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40997
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:36.432579 11173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:36.432762 11173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:36.432786 11173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:36.433835 11173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:36.433866 11173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:36.433892 11173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:16:36.435266 11173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40997
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:36.435444 11173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:36.435604 11173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:36.440310 11189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:36.440331 11180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:36.440346 11182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:36.440771 11173 server_base.cc:1034] running on GCE node
I20260811 07:16:36.441035 11173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:36.441282 11173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:36.442449 11173 hybrid_clock.cc:648] HybridClock initialized: now 1786432596442435 us; error 29 us; skew 500 ppm
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:36.445015 11173 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:16:36.445497 11173 webserver.cc:460] Webserver started at http://127.9.142.130:36577/ using document root <none> and password file <none>
I20260811 07:16:36.445744 11173 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:36.445813 11173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:36.445971 11173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:36.446985 11173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "911df4f2efc8497fb1a23a072278c1fe"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "1801539e493c281543b5000940293d62"
server_key_iv: "607de162e03c5df04e2e4ecbce3c076e"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.447348 11173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "911df4f2efc8497fb1a23a072278c1fe"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "1801539e493c281543b5000940293d62"
server_key_iv: "607de162e03c5df04e2e4ecbce3c076e"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.448769 11173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:36.449517 11202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.449723 11173 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:36.449826 11173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "911df4f2efc8497fb1a23a072278c1fe"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "1801539e493c281543b5000940293d62"
server_key_iv: "607de162e03c5df04e2e4ecbce3c076e"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.449918 11173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:36.474294 11173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:36.476249 11173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:36.476419 11173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:36.476665 11173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:36.476987 11173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:36.477044 11173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.477088 11173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:36.477136 11173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.483484 11173 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:42291
I20260811 07:16:36.483547 11415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:42291 every 8 connection(s)
I20260811 07:16:36.483919 11173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:16:36.484386 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 11173
I20260811 07:16:36.484499 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:16:36.484707 9786 external_mini_cluster.cc:1428] Setting key 322b79b46316023f699f2a236a031748
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:36.494616 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.484773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:38373 (local address 127.9.142.190:40997)
0811 07:16:36.484825 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.484827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.485078 (+ 251us) server_negotiation.cc:407] Connection header received
0811 07:16:36.486132 (+ 1054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.486134 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.486146 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.486203 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:36.486865 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.487458 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.488566 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.488873 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.488947 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.491439 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:36.491441 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:36.491441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:36.491451 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:36.493133 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.493546 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.493547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.493547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.493608 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.493851 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.493853 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.493853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.494008 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:36.494089 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.494398 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.494499 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:16:36.494673 11419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.484777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:40997 (local address 127.9.142.130:38373)
0811 07:16:36.484957 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:36.485001 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:36.486020 (+ 1019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:36.486277 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:36.486281 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:36.486553 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:36.486748 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.486752 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.487582 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.487583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.488467 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.488470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.488967 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.488968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.489083 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.489863 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:36.489872 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:36.491333 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:36.493231 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:36.493237 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:36.493239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:36.493456 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:36.493682 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:36.493683 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:36.493683 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:36.493781 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:36.494088 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:36.494093 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:36.494208 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 07:16:36.494364 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 07:16:36.494505 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
I20260811 07:16:36.495195 11416 heartbeater.cc:347] Connected to a master server at 127.9.142.190:40997
I20260811 07:16:36.495287 11416 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:36.495438 11416 heartbeater.cc:511] Master 127.9.142.190:40997 requested a full tablet report, sending...
I20260811 07:16:36.495949 10815 ts_manager.cc:194] Registered new tserver with Master: 911df4f2efc8497fb1a23a072278c1fe (127.9.142.130:42291)
I20260811 07:16:36.496369 10815 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:38373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:16:36.514192 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40997
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:36.600036 11425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:36.600252 11425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:36.600289 11425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:36.601421 11425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:36.601487 11425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:36.601533 11425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:16:36.603019 11425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40997
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:36.603278 11425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:36.603508 11425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:36.608340 11439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:36.608455 11436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:36.608465 11433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:36.608642 11425 server_base.cc:1034] running on GCE node
I20260811 07:16:36.608863 11425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:36.609091 11425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:36.610234 11425 hybrid_clock.cc:648] HybridClock initialized: now 1786432596610213 us; error 35 us; skew 500 ppm
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:36.612747 11425 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:16:36.613210 11425 webserver.cc:460] Webserver started at http://127.9.142.131:46665/ using document root <none> and password file <none>
I20260811 07:16:36.613448 11425 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:36.613516 11425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:36.613662 11425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:36.614641 11425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "40899bcca61141cc9c1fb95953173960"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "bc2523cec6011d898efc9c60b19d57ba"
server_key_iv: "c7b4626ffffd1132c6be6a4bc92c197f"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.614991 11425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "40899bcca61141cc9c1fb95953173960"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "bc2523cec6011d898efc9c60b19d57ba"
server_key_iv: "c7b4626ffffd1132c6be6a4bc92c197f"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.616384 11425 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:36.617111 11455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.617288 11425 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:36.617396 11425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "40899bcca61141cc9c1fb95953173960"
format_stamp: "Formatted at 2026-08-11 07:16:36 on dist-test-slave-7f01"
server_key: "bc2523cec6011d898efc9c60b19d57ba"
server_key_iv: "c7b4626ffffd1132c6be6a4bc92c197f"
server_key_version: "encryptionkey@0"
I20260811 07:16:36.617467 11425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:36.629647 11425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:36.631356 11425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:36.631515 11425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:36.631726 11425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:36.632109 11425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:36.632165 11425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.632205 11425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:36.632232 11425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:36.638115 11425 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:34843
I20260811 07:16:36.638227 11657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:34843 every 8 connection(s)
I20260811 07:16:36.638496 11425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:16:36.639377 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 11425
I20260811 07:16:36.639492 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:16:36.639654 9786 external_mini_cluster.cc:1428] Setting key 960f09e4ec2b37a3a4d6b64a9bb77d90
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:36.647432 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.639220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:44443 (local address 127.9.142.190:40997)
0811 07:16:36.639293 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.639295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.639468 (+ 173us) server_negotiation.cc:407] Connection header received
0811 07:16:36.640699 (+ 1231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.640700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.640712 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.640776 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:36.641346 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.641838 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.642787 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.642978 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.643031 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.645021 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:36.645023 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:36.645023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:36.645029 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:36.646280 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.646648 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.646649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.646649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.646701 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.646922 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.646923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.646923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.647031 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:36.647084 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.647306 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.647368 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 07:16:36.647603 11661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.639187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:40997 (local address 127.9.142.131:44443)
0811 07:16:36.639339 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:36.639379 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:36.640600 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:36.640829 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:36.640832 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:36.641082 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:36.641273 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.641277 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.641921 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.641922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.642710 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.642712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.643054 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.643055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.643159 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.643567 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:36.643575 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:36.644937 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:36.646353 (+ 1416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:36.646360 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:36.646361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:36.646582 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:36.646761 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:36.646762 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:36.646762 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:36.646867 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:36.647088 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:36.647092 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:36.647195 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 07:16:36.647272 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 07:16:36.647384 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260811 07:16:36.648167 11658 heartbeater.cc:347] Connected to a master server at 127.9.142.190:40997
I20260811 07:16:36.648283 11658 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:36.648476 11658 heartbeater.cc:511] Master 127.9.142.190:40997 requested a full tablet report, sending...
I20260811 07:16:36.648874 10815 ts_manager.cc:194] Registered new tserver with Master: 40899bcca61141cc9c1fb95953173960 (127.9.142.131:34843)
I20260811 07:16:36.649259 10815 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:44443
I20260811 07:16:36.651469 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:16:36.658604 10886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.653129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54600 (local address 127.9.142.190:40997)
0811 07:16:36.653166 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.653168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.653282 (+ 114us) server_negotiation.cc:407] Connection header received
0811 07:16:36.653347 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.653347 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.653355 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.653394 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:36.653997 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.654505 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.655203 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.655374 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.655424 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.656549 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:36.656550 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:36.656550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:36.656556 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:36.657662 (+ 1106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.657972 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.657973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.657973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.658026 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.658195 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.658195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.658196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.658326 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:36.658401 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.658490 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.658546 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 07:16:36.660836 10815 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:16:36.662499 10815 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:36.669443 11683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.665139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46438 (local address 127.9.142.129:45671)
0811 07:16:36.665830 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.665835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.665845 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:16:36.665885 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.665887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.665904 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.665994 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:36.666078 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.667133 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.668366 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.669072 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.669147 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.669205 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.669350 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.669382 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":93,"threads_started":1}
I20260811 07:16:36.669445 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.664931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:45671 (local address 127.0.0.1:46438)
0811 07:16:36.665254 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:36.665298 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:36.665371 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:36.665985 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:36.665986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:36.665988 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:36.666027 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.666028 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.667269 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.667270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.668251 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.668254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.669160 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.669161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.669244 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.669257 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 07:16:36.669326 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:16:36.669372 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":63,"threads_started":1}
I20260811 07:16:36.669958 11681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.665103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49558 (local address 127.9.142.131:34843)
0811 07:16:36.665509 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.665513 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.665521 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:16:36.665552 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.665553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.665565 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.665664 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:36.665862 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.666976 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.668330 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.669065 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.669146 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.669205 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.669834 (+ 629us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.669883 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":91,"threads_started":1}
I20260811 07:16:36.670184 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.664931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:34843 (local address 127.0.0.1:49558)
0811 07:16:36.665285 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:36.665303 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:36.665371 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:36.665698 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:36.665702 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:36.665705 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:36.665789 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.665791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.667082 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.667083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.668232 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.668235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.669651 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.669652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.669727 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.669731 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:16:36.670068 (+ 337us) client_negotiation.cc:240] Negotiation successful
0811 07:16:36.670116 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":29,"thread_start_us":85,"threads_started":1}
I20260811 07:16:36.670202 11032 tablet_service.cc:1467] Processing CreateTablet for tablet 3a2ae8ff5cfe45a88d85c51db4b7e46a (DEFAULT_TABLE table=test-table [id=a2454e4b26374e27b82265664810cb53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:36.670605 11032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a2ae8ff5cfe45a88d85c51db4b7e46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:36.670825 11539 tablet_service.cc:1467] Processing CreateTablet for tablet 3a2ae8ff5cfe45a88d85c51db4b7e46a (DEFAULT_TABLE table=test-table [id=a2454e4b26374e27b82265664810cb53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:36.671132 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.664954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42291 (local address 127.0.0.1:43234)
0811 07:16:36.665330 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:36.665338 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:36.665383 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:36.667526 (+ 2143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:36.667527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:36.667529 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:36.667576 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.667577 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.668754 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.668755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.669662 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.669664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.670879 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.670880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.670943 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.670949 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:16:36.671021 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 07:16:36.671060 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":115,"threads_started":1}
I20260811 07:16:36.671192 11539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a2ae8ff5cfe45a88d85c51db4b7e46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:36.671387 11686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.665240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43234 (local address 127.9.142.130:42291)
0811 07:16:36.667338 (+ 2098us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.667343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.667352 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:16:36.667407 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.667409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.667425 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.667507 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:36.667693 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.668651 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.669753 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.670783 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.670866 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.670927 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.671102 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.671159 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2054,"thread_start_us":85,"threads_started":1}
I20260811 07:16:36.672151 11292 tablet_service.cc:1467] Processing CreateTablet for tablet 3a2ae8ff5cfe45a88d85c51db4b7e46a (DEFAULT_TABLE table=test-table [id=a2454e4b26374e27b82265664810cb53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:36.672498 11292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a2ae8ff5cfe45a88d85c51db4b7e46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:36.674243 11687 tablet_bootstrap.cc:492] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960: Bootstrap starting.
I20260811 07:16:36.674464 11688 tablet_bootstrap.cc:492] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0: Bootstrap starting.
I20260811 07:16:36.674911 11687 tablet_bootstrap.cc:654] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:36.675179 11688 tablet_bootstrap.cc:654] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:36.675511 11687 log.cc:824] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:36.675840 11688 log.cc:824] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:36.676309 11690 tablet_bootstrap.cc:492] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe: Bootstrap starting.
I20260811 07:16:36.676594 11687 tablet_bootstrap.cc:492] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960: No bootstrap required, opened a new log
I20260811 07:16:36.676669 11688 tablet_bootstrap.cc:492] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0: No bootstrap required, opened a new log
I20260811 07:16:36.676695 11687 ts_tablet_manager.cc:1397] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:16:36.676743 11688 ts_tablet_manager.cc:1397] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:16:36.676994 11690 tablet_bootstrap.cc:654] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:36.677723 11690 log.cc:824] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:36.678587 11690 tablet_bootstrap.cc:492] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe: No bootstrap required, opened a new log
I20260811 07:16:36.678660 11690 ts_tablet_manager.cc:1397] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:16:36.678748 11687 raft_consensus.cc:348] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } }
I20260811 07:16:36.678930 11687 raft_consensus.cc:374] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:36.678983 11687 raft_consensus.cc:729] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40899bcca61141cc9c1fb95953173960, State: Initialized, Role: FOLLOWER
I20260811 07:16:36.679108 11687 consensus_queue.cc:260] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } }
I20260811 07:16:36.679131 11688 raft_consensus.cc:348] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } }
I20260811 07:16:36.679315 11688 raft_consensus.cc:374] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:36.679363 11688 raft_consensus.cc:729] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23abbe0084ff40d79e1582d33f6566b0, State: Initialized, Role: FOLLOWER
I20260811 07:16:36.679447 11687 ts_tablet_manager.cc:1428] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:16:36.679571 11658 heartbeater.cc:503] Master 127.9.142.190:40997 was elected leader, sending a full tablet report...
I20260811 07:16:36.679541 11688 consensus_queue.cc:260] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } }
I20260811 07:16:36.679850 11164 heartbeater.cc:503] Master 127.9.142.190:40997 was elected leader, sending a full tablet report...
I20260811 07:16:36.679898 11688 ts_tablet_manager.cc:1428] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:16:36.681025 11690 raft_consensus.cc:348] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } }
I20260811 07:16:36.681191 11690 raft_consensus.cc:374] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:36.681236 11690 raft_consensus.cc:729] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911df4f2efc8497fb1a23a072278c1fe, State: Initialized, Role: FOLLOWER
I20260811 07:16:36.681336 11690 consensus_queue.cc:260] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } }
I20260811 07:16:36.681576 11690 ts_tablet_manager.cc:1428] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:16:36.681651 11416 heartbeater.cc:503] Master 127.9.142.190:40997 was elected leader, sending a full tablet report...
I20260811 07:16:36.728221 11696 raft_consensus.cc:482] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:36.728408 11696 raft_consensus.cc:504] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } }
I20260811 07:16:36.728837 11696 leader_election.cc:288] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40899bcca61141cc9c1fb95953173960 (127.9.142.131:34843), 911df4f2efc8497fb1a23a072278c1fe (127.9.142.130:42291)
I20260811 07:16:36.731832 11167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.729018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42291 (local address 127.9.142.129:50085)
0811 07:16:36.729088 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:36.729101 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:36.729148 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:36.729302 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:36.729303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:36.729304 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:36.729404 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.729406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.730125 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.730126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.730910 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.730913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.731551 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.731553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.731642 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.731646 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:16:36.731703 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 07:16:36.731767 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 07:16:36.731866 11686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.729105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:50085 (local address 127.9.142.130:42291)
0811 07:16:36.729155 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.729158 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.729169 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:16:36.729203 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.729204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.729215 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.729292 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:36.729497 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.730038 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.731010 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.731463 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.731522 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.731530 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.731724 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.731788 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:16:36.732043 11699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.729018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:34843 (local address 127.9.142.129:57617)
0811 07:16:36.729260 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:36.729272 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:36.729333 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:36.729487 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:36.729488 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:36.729489 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:36.729570 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.729572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.730244 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.730245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.731069 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:36.731071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.731756 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.731758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:36.731827 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.731832 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:16:36.731893 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 07:16:36.731935 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":38,"thread_start_us":129,"threads_started":1}
I20260811 07:16:36.732048 11681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.729112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:57617 (local address 127.9.142.131:34843)
0811 07:16:36.729155 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.729158 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.729341 (+ 183us) server_negotiation.cc:407] Connection header received
0811 07:16:36.729395 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.729397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.729406 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.729460 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:36.729640 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.730155 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.731156 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.731639 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.731713 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.731721 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.731918 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.731968 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:16:36.732184 11329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a2ae8ff5cfe45a88d85c51db4b7e46a" candidate_uuid: "23abbe0084ff40d79e1582d33f6566b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911df4f2efc8497fb1a23a072278c1fe" is_pre_election: true
I20260811 07:16:36.732352 11329 raft_consensus.cc:2454] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23abbe0084ff40d79e1582d33f6566b0 in term 0.
I20260811 07:16:36.732388 11575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a2ae8ff5cfe45a88d85c51db4b7e46a" candidate_uuid: "23abbe0084ff40d79e1582d33f6566b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40899bcca61141cc9c1fb95953173960" is_pre_election: true
I20260811 07:16:36.732532 11575 raft_consensus.cc:2454] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23abbe0084ff40d79e1582d33f6566b0 in term 0.
I20260811 07:16:36.732641 10944 leader_election.cc:302] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23abbe0084ff40d79e1582d33f6566b0, 911df4f2efc8497fb1a23a072278c1fe; no voters:
I20260811 07:16:36.732779 11696 raft_consensus.cc:2781] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:36.732870 11696 raft_consensus.cc:482] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:36.732906 11696 raft_consensus.cc:3037] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:36.733729 11696 raft_consensus.cc:504] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } }
I20260811 07:16:36.733882 11696 leader_election.cc:288] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [CANDIDATE]: Term 1 election: Requested vote from peers 40899bcca61141cc9c1fb95953173960 (127.9.142.131:34843), 911df4f2efc8497fb1a23a072278c1fe (127.9.142.130:42291)
I20260811 07:16:36.734059 11575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a2ae8ff5cfe45a88d85c51db4b7e46a" candidate_uuid: "23abbe0084ff40d79e1582d33f6566b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40899bcca61141cc9c1fb95953173960"
I20260811 07:16:36.734053 11329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a2ae8ff5cfe45a88d85c51db4b7e46a" candidate_uuid: "23abbe0084ff40d79e1582d33f6566b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911df4f2efc8497fb1a23a072278c1fe"
I20260811 07:16:36.734136 11575 raft_consensus.cc:3037] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:36.734136 11329 raft_consensus.cc:3037] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe [term 0 FOLLOWER]: Advancing to term 1
W20260811 07:16:36.734514 11418 tablet.cc:2369] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:16:36.735146 11575 raft_consensus.cc:2454] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 40899bcca61141cc9c1fb95953173960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23abbe0084ff40d79e1582d33f6566b0 in term 1.
I20260811 07:16:36.735138 11329 raft_consensus.cc:2454] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 911df4f2efc8497fb1a23a072278c1fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23abbe0084ff40d79e1582d33f6566b0 in term 1.
I20260811 07:16:36.735335 10949 leader_election.cc:302] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23abbe0084ff40d79e1582d33f6566b0, 40899bcca61141cc9c1fb95953173960; no voters:
I20260811 07:16:36.735476 11696 raft_consensus.cc:2781] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:36.735651 11696 raft_consensus.cc:686] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [term 1 LEADER]: Becoming Leader. State: Replica: 23abbe0084ff40d79e1582d33f6566b0, State: Running, Role: LEADER
I20260811 07:16:36.735777 11696 consensus_queue.cc:237] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } }
I20260811 07:16:36.736606 10814 catalog_manager.cc:5495] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23abbe0084ff40d79e1582d33f6566b0 (127.9.142.129). New cstate: current_term: 1 leader_uuid: "23abbe0084ff40d79e1582d33f6566b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23abbe0084ff40d79e1582d33f6566b0" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40899bcca61141cc9c1fb95953173960" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 34843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "911df4f2efc8497fb1a23a072278c1fe" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42291 } health_report { overall_health: UNKNOWN } } }
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:16:36.763501 11683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.756650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46452 (local address 127.9.142.129:45671)
0811 07:16:36.756711 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.756714 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.756830 (+ 116us) server_negotiation.cc:407] Connection header received
0811 07:16:36.756879 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.756879 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.756888 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.756927 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:36.757488 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.757923 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.758624 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.758798 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.758845 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.761084 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:36.761092 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:36.761092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:36.761098 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:36.762505 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.762822 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.762824 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.762824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.762878 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.763045 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.763046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.763046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.763170 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:36.763293 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.763327 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.763387 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:16:36.789368 11683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.782302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46456 (local address 127.9.142.129:45671)
0811 07:16:36.782368 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.782370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.782465 (+ 95us) server_negotiation.cc:407] Connection header received
0811 07:16:36.782515 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.782515 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.782525 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.782575 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:36.783081 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.783566 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.784321 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.784582 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.784633 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.786785 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:36.786786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:36.786786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:36.786792 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:36.788071 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.788469 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.788470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.788470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.788525 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.788741 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.788741 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.788741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.788834 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:36.788919 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.789062 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.789129 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[10742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:16:36.813047 11683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:36.806201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46466 (local address 127.9.142.129:45671)
0811 07:16:36.806289 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:36.806291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:36.806373 (+ 82us) server_negotiation.cc:407] Connection header received
0811 07:16:36.806407 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:36.806408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:36.806417 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:36.806467 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:36.807027 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.807495 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.808250 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:36.808468 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:36.808532 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:36.810735 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:36.810737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:36.810737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:36.810743 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:36.812030 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.812333 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.812334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.812334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.812387 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:36.812589 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:36.812591 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:36.812591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:36.812702 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:36.812792 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:36.812869 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 07:16:36.812929 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 07:16:36.813597 10993 tablet_service.cc:2908] Rejecting scan request for tablet 3a2ae8ff5cfe45a88d85c51db4b7e46a: Uninitialized: clean time has not yet been initialized
W20260811 07:16:36.814309 11165 tablet.cc:2369] T 3a2ae8ff5cfe45a88d85c51db4b7e46a P 23abbe0084ff40d79e1582d33f6566b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:16:36.814507 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 10917
I20260811 07:16:36.828511 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 11173
I20260811 07:16:36.841091 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 11425
I20260811 07:16:36.851238 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 10761
2026-08-11T07:16:36Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2310 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[11731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[11731](info): set up 2 sockets
Aug 11 07:16:36 dist-test-slave-7f01 krb5kdc[11731](info): commencing operation
krb5kdc: starting...
W20260811 07:16:38.124377 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:16:38.248377 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35747
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:35747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:38.331401 11755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:38.331616 11755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:38.331640 11755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:38.332835 11755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:38.332882 11755 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:16:38.332896 11755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:38.332911 11755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:38.332922 11755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:38.332934 11755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:38.334444 11755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:35747
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:38.334705 11755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:38.334957 11755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:38.339845 11764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:38.339866 11762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:38.339850 11767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:38.340099 11755 server_base.cc:1034] running on GCE node
I20260811 07:16:38.340368 11755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:38.340723 11755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:38.341876 11755 hybrid_clock.cc:648] HybridClock initialized: now 1786432598341849 us; error 42 us; skew 500 ppm
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:38.347597 11755 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:16:38.348109 11755 webserver.cc:460] Webserver started at http://127.9.142.190:42467/ using document root <none> and password file <none>
I20260811 07:16:38.348374 11755 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:38.348450 11755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:38.348603 11755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:38.349709 11755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "bd5e8437891e47e3834c556cbba19b7a"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "90dd2a197367abb360838fc428100b37"
server_key_iv: "54861ce8efca87d7bb20c42320f67c53"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.350090 11755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "bd5e8437891e47e3834c556cbba19b7a"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "90dd2a197367abb360838fc428100b37"
server_key_iv: "54861ce8efca87d7bb20c42320f67c53"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.351488 11755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:16:38.352296 11780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:38.352471 11755 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:38.352584 11755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "bd5e8437891e47e3834c556cbba19b7a"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "90dd2a197367abb360838fc428100b37"
server_key_iv: "54861ce8efca87d7bb20c42320f67c53"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.352661 11755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:38.361482 11755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:38.363227 11755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:38.363394 11755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:38.368534 11755 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:35747
I20260811 07:16:38.368578 11907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:35747 every 8 connection(s)
I20260811 07:16:38.368903 11755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:38.369596 11909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:38.372035 11909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a: Bootstrap starting.
I20260811 07:16:38.372700 11909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:38.372929 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 11755
I20260811 07:16:38.373029 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:38.373090 11909 log.cc:824] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:38.373215 9786 external_mini_cluster.cc:1428] Setting key baf70033594d81994aa9a5ee023a211d
I20260811 07:16:38.373953 11909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a: No bootstrap required, opened a new log
I20260811 07:16:38.376217 11909 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5e8437891e47e3834c556cbba19b7a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35747 } }
I20260811 07:16:38.376375 11909 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:38.376441 11909 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd5e8437891e47e3834c556cbba19b7a, State: Initialized, Role: FOLLOWER
I20260811 07:16:38.376602 11909 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5e8437891e47e3834c556cbba19b7a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35747 } }
I20260811 07:16:38.376711 11909 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:38.376758 11909 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:38.376807 11909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:38.377363 11909 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5e8437891e47e3834c556cbba19b7a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35747 } }
I20260811 07:16:38.377492 11909 leader_election.cc:302] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd5e8437891e47e3834c556cbba19b7a; no voters:
I20260811 07:16:38.377694 11909 leader_election.cc:288] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:38.377753 11920 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:38.377956 11920 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [term 1 LEADER]: Becoming Leader. State: Replica: bd5e8437891e47e3834c556cbba19b7a, State: Running, Role: LEADER
I20260811 07:16:38.378082 11909 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:38.378270 11920 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5e8437891e47e3834c556cbba19b7a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35747 } }
I20260811 07:16:38.378777 11920 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd5e8437891e47e3834c556cbba19b7a. Latest consensus state: current_term: 1 leader_uuid: "bd5e8437891e47e3834c556cbba19b7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5e8437891e47e3834c556cbba19b7a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35747 } } }
I20260811 07:16:38.378870 11920 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:38.378819 11925 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd5e8437891e47e3834c556cbba19b7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd5e8437891e47e3834c556cbba19b7a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35747 } } }
I20260811 07:16:38.379083 11925 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:38.379151 11933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:38.379787 11933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:38.381831 11933 catalog_manager.cc:1347] Generated new cluster ID: cff9aa8c284f465b9381a964d725635c
I20260811 07:16:38.382146 11933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:16:38.384631 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.373755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58890 (local address 127.9.142.190:35747)
0811 07:16:38.373939 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.373949 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.373989 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:16:38.374463 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.374469 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.374517 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.374663 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:38.375345 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.376331 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.377205 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.377757 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.380636 (+ 2879us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.380997 (+ 361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:38.381001 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:38.381001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:38.381013 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:38.382837 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.383358 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.383362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.383362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.383466 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.383683 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.383684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.383684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.384011 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:38.384228 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.384296 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.384446 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260811 07:16:38.389518 11933 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:38.390007 11933 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:38.400506 11933 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a: Generated new TSK 0
I20260811 07:16:38.400707 11933 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:16:38.434813 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:35747
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:38.542562 11953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:38.542764 11953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:38.542788 11953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:38.543918 11953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:38.543959 11953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:38.543980 11953 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:16:38.543998 11953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:16:38.545356 11953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.142.190:35747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:38.545542 11953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:38.545706 11953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:38.550585 11965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:38.550621 11961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:38.550582 11963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:38.550983 11953 server_base.cc:1034] running on GCE node
I20260811 07:16:38.551180 11953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:38.551366 11953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:38.552546 11953 hybrid_clock.cc:648] HybridClock initialized: now 1786432598552529 us; error 32 us; skew 500 ppm
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:38.554931 11953 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:16:38.555500 11953 webserver.cc:460] Webserver started at http://127.9.142.129:38557/ using document root <none> and password file <none>
I20260811 07:16:38.555812 11953 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:38.555889 11953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:38.556052 11953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:38.557132 11953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "393a1e05d38b4dba80921d40f30124f2"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "427579a2d89f17fb7b0b0440856bcffa"
server_key_iv: "baf3ef460079f52440f5b5a593b913a6"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.557505 11953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "393a1e05d38b4dba80921d40f30124f2"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "427579a2d89f17fb7b0b0440856bcffa"
server_key_iv: "baf3ef460079f52440f5b5a593b913a6"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.558842 11953 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:38.559576 11977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:38.559793 11953 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:38.560014 11953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "393a1e05d38b4dba80921d40f30124f2"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "427579a2d89f17fb7b0b0440856bcffa"
server_key_iv: "baf3ef460079f52440f5b5a593b913a6"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.560151 11953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:38.570433 11953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:38.572314 11953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:38.572466 11953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:38.572988 11953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:38.573052 11953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:38.573086 11953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:38.573118 11953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:38.580998 11953 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:40939
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:38.581068 12187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:40939 every 8 connection(s)
I20260811 07:16:38.581477 11953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:16:38.584321 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.573635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:60827 (local address 127.9.142.190:35747)
0811 07:16:38.573677 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.573680 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.573931 (+ 251us) server_negotiation.cc:407] Connection header received
0811 07:16:38.574449 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.574450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.574464 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.574530 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:38.575536 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.576429 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.578130 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.578465 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.578548 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.581587 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:38.581588 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:38.581589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:38.581596 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:38.583004 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.583374 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.583374 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.583375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.583427 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.583625 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.583626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.583626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.583728 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:38.583835 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.584130 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.584229 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:16:38.584493 11995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.573633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35747 (local address 127.9.142.129:60827)
0811 07:16:38.573814 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:38.573849 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:38.574341 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:38.574654 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:38.574660 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:38.575060 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:38.575407 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.575415 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.576541 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.576542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.578015 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.578019 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.578580 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.578582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.578780 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.579385 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:38.579401 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:38.581485 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:38.583081 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.583087 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.583089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.583307 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.583479 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.583479 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.583479 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.583573 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.583827 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:38.583835 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:38.583982 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 07:16:38.584090 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:16:38.584253 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260811 07:16:38.585033 12189 heartbeater.cc:347] Connected to a master server at 127.9.142.190:35747
I20260811 07:16:38.585142 12189 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:38.585321 12189 heartbeater.cc:511] Master 127.9.142.190:35747 requested a full tablet report, sending...
I20260811 07:16:38.585948 11823 ts_manager.cc:194] Registered new tserver with Master: 393a1e05d38b4dba80921d40f30124f2 (127.9.142.129:40939)
I20260811 07:16:38.586915 11823 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:60827
I20260811 07:16:38.590639 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 11953
I20260811 07:16:38.590757 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:16:38.590968 9786 external_mini_cluster.cc:1428] Setting key 685f5388f2b53dd151212e6aaf41e5d0
I20260811 07:16:38.591971 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.586252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:51641 (local address 127.9.142.190:35747)
0811 07:16:38.586295 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.586297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.586417 (+ 120us) server_negotiation.cc:407] Connection header received
0811 07:16:38.586485 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.586486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.586493 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.586532 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:38.586891 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.587599 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.588335 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.588604 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.588680 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.589464 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:38.589465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:38.589466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:38.589471 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:38.590654 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.591101 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.591102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.591102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.591201 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.591436 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.591436 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.591437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.591564 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:38.591634 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.591795 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.591877 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:16:38.592006 12197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.586180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35747 (local address 127.9.142.129:51641)
0811 07:16:38.586353 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:38.586365 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:38.586426 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:38.586546 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:38.586547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:38.586744 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:38.586821 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.586823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.587699 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.587700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.588259 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.588261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.588686 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.588687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.588747 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.589097 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:38.589101 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:38.589359 (+ 258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:38.590767 (+ 1408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.590768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.590769 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.590986 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.591282 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.591283 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.591283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.591357 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.591631 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:38.591632 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:38.591670 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:16:38.591722 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 07:16:38.591882 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:16:38.619228 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:35747
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:38.704156 12200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:38.704402 12200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:38.704445 12200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:38.705652 12200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:38.705717 12200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:38.705752 12200 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:16:38.705798 12200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:16:38.707254 12200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.142.190:35747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:38.707531 12200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:38.707770 12200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:38.712657 12212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:38.712623 12208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:38.712646 12210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:38.712973 12200 server_base.cc:1034] running on GCE node
I20260811 07:16:38.713184 12200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:38.713423 12200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:38.714582 12200 hybrid_clock.cc:648] HybridClock initialized: now 1786432598714569 us; error 43 us; skew 500 ppm
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:38.717141 12200 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:16:38.717573 12200 webserver.cc:460] Webserver started at http://127.9.142.130:35317/ using document root <none> and password file <none>
I20260811 07:16:38.717816 12200 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:38.717888 12200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:38.718044 12200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:38.719070 12200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "fa4de3c93169456abaf0368b7558f313"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "16e909b256f4bacb40328361925ee3d7"
server_key_iv: "f6813f4ccf04d2a06a83c8502a4185d3"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.719460 12200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "fa4de3c93169456abaf0368b7558f313"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "16e909b256f4bacb40328361925ee3d7"
server_key_iv: "f6813f4ccf04d2a06a83c8502a4185d3"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.720849 12200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:38.721593 12228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:38.721772 12200 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:38.721884 12200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "fa4de3c93169456abaf0368b7558f313"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "16e909b256f4bacb40328361925ee3d7"
server_key_iv: "f6813f4ccf04d2a06a83c8502a4185d3"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.721961 12200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:38.745817 12200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:38.748025 12200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:38.748188 12200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:38.748775 12200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:38.748836 12200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:38.748876 12200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:38.748908 12200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:38.756371 12200 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:45947
I20260811 07:16:38.756462 12447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:45947 every 8 connection(s)
I20260811 07:16:38.756831 12200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:16:38.759100 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.749215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:50799 (local address 127.9.142.190:35747)
0811 07:16:38.749268 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.749270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.749484 (+ 214us) server_negotiation.cc:407] Connection header received
0811 07:16:38.750031 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.750033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.750048 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.750101 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:38.751054 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.751925 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.752949 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.753169 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.753260 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.756478 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:38.756479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:38.756480 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:38.756488 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:38.757974 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.758353 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.758354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.758354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.758407 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.758595 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.758596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.758596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.758697 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:38.758748 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.758967 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.759034 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:16:38.759258 12255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.749205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35747 (local address 127.9.142.130:50799)
0811 07:16:38.749363 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:38.749397 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:38.749913 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:38.750174 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:38.750177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:38.750566 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:38.750896 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.750903 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.752038 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.752039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.752849 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.752851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.753291 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.753292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.753427 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.753953 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:38.753961 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:38.756325 (+ 2364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:38.758054 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.758060 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.758062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.758282 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.758449 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.758449 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.758449 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.758544 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.758757 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:38.758763 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:38.758869 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 07:16:38.758949 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:16:38.759069 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
I20260811 07:16:38.759814 12448 heartbeater.cc:347] Connected to a master server at 127.9.142.190:35747
I20260811 07:16:38.759904 12448 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:38.760097 12448 heartbeater.cc:511] Master 127.9.142.190:35747 requested a full tablet report, sending...
I20260811 07:16:38.760506 11823 ts_manager.cc:194] Registered new tserver with Master: fa4de3c93169456abaf0368b7558f313 (127.9.142.130:45947)
I20260811 07:16:38.760917 11823 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:50799
I20260811 07:16:38.764664 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 12200
I20260811 07:16:38.764776 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:16:38.764973 9786 external_mini_cluster.cc:1428] Setting key 3cc323987cde90e16a18a94bb874c9fd
I20260811 07:16:38.766849 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.760974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:36157 (local address 127.9.142.190:35747)
0811 07:16:38.761014 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.761016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.761095 (+ 79us) server_negotiation.cc:407] Connection header received
0811 07:16:38.761165 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.761166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.761175 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.761219 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:38.761561 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.762025 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.762781 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.762990 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.763077 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.764055 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:38.764056 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:38.764056 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:38.764064 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:38.765650 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.765989 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.765991 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.765991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.766049 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.766269 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.766270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.766270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.766418 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:38.766497 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.766672 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.766747 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:16:38.766860 12463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.760883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35747 (local address 127.9.142.130:36157)
0811 07:16:38.761031 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:38.761043 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:38.761108 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:38.761222 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:38.761223 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:38.761408 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:38.761481 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.761482 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.762124 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.762125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.762634 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.762635 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.763081 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.763082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.763160 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.763592 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:38.763597 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:38.763965 (+ 368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:38.765733 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.765734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.765734 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.765910 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.766132 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.766133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.766133 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.766199 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.766503 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:38.766504 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:38.766551 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 07:16:38.766631 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:16:38.766737 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:16:38.792788 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:35747
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:38.881897 12466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:38.882103 12466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:38.882128 12466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:38.883210 12466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:38.883245 12466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:38.883265 12466 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:16:38.883289 12466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:16:38.884826 12466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.142.190:35747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:38.885017 12466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:38.885197 12466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:38.890273 12477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:38.890300 12474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:38.890396 12475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:38.890707 12466 server_base.cc:1034] running on GCE node
I20260811 07:16:38.890933 12466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:38.891175 12466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:38.892338 12466 hybrid_clock.cc:648] HybridClock initialized: now 1786432598892322 us; error 29 us; skew 500 ppm
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:38.894793 12466 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:16:38.895217 12466 webserver.cc:460] Webserver started at http://127.9.142.131:41677/ using document root <none> and password file <none>
I20260811 07:16:38.895463 12466 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:38.895537 12466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:38.895690 12466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:38.897156 12466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "34c3cc1b7e8841b982c363e010b658a9"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "be69dae11fb5fdb6c196080678bca039"
server_key_iv: "8da8525f63b418fa8732921e65161511"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.897634 12466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "34c3cc1b7e8841b982c363e010b658a9"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "be69dae11fb5fdb6c196080678bca039"
server_key_iv: "8da8525f63b418fa8732921e65161511"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.899137 12466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:16:38.899919 12492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:38.900104 12466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:38.900211 12466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "34c3cc1b7e8841b982c363e010b658a9"
format_stamp: "Formatted at 2026-08-11 07:16:38 on dist-test-slave-7f01"
server_key: "be69dae11fb5fdb6c196080678bca039"
server_key_iv: "8da8525f63b418fa8732921e65161511"
server_key_version: "encryptionkey@0"
I20260811 07:16:38.900295 12466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:38.909637 12466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:38.911477 12466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:38.911638 12466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:38.912204 12466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:38.912278 12466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:38.912321 12466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:38.912349 12466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:38.919503 12466 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:36453
I20260811 07:16:38.919584 12687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:36453 every 8 connection(s)
I20260811 07:16:38.919941 12466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:16:38.922854 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.912724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:42363 (local address 127.9.142.190:35747)
0811 07:16:38.912800 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.912803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.912955 (+ 152us) server_negotiation.cc:407] Connection header received
0811 07:16:38.913418 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.913420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.913436 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.913521 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:38.914308 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.915152 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.916738 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.917092 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.917177 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.920043 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:38.920045 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:38.920045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:38.920053 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:38.921431 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.921848 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.921849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.921850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.921922 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.922186 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.922186 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.922187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.922309 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:38.922389 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.922673 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.922759 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 07:16:38.923041 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.912652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35747 (local address 127.9.142.131:42363)
0811 07:16:38.912830 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:38.912869 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:38.913323 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:38.913588 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:38.913591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:38.913929 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:38.914201 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.914206 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.915286 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.915287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.916640 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.916644 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.917205 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.917207 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.917385 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.917983 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:38.917991 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:38.919946 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:38.921532 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.921539 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.921541 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.921761 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.921990 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.921991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.921991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.922107 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.922379 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:38.922387 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:38.922531 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 07:16:38.922642 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:16:38.922819 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260811 07:16:38.923579 12688 heartbeater.cc:347] Connected to a master server at 127.9.142.190:35747
I20260811 07:16:38.923686 12688 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:38.923890 12688 heartbeater.cc:511] Master 127.9.142.190:35747 requested a full tablet report, sending...
I20260811 07:16:38.924335 11823 ts_manager.cc:194] Registered new tserver with Master: 34c3cc1b7e8841b982c363e010b658a9 (127.9.142.131:36453)
I20260811 07:16:38.924875 11823 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:42363
I20260811 07:16:38.928723 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 12466
I20260811 07:16:38.928833 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:16:38.928992 9786 external_mini_cluster.cc:1428] Setting key 9443f0cb359fd79cebbc222c52968a13
I20260811 07:16:38.929978 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:16:38.930032 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.924689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:51969 (local address 127.9.142.190:35747)
0811 07:16:38.924727 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.924729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.924800 (+ 71us) server_negotiation.cc:407] Connection header received
0811 07:16:38.924873 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.924874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.924884 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.924942 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:38.925328 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.925842 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.926475 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.926644 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.926692 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.927587 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:38.927588 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:38.927589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:38.927595 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:38.928773 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.929155 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.929157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.929157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.929239 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.929471 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.929471 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.929472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.929612 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:38.929682 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.929857 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.929942 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:16:38.930064 12696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.924580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35747 (local address 127.9.142.131:51969)
0811 07:16:38.924747 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:38.924757 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:38.924819 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:38.924965 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:38.924966 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:38.925160 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:38.925255 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.925258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.925933 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.925934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.926402 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.926403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.926710 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.926711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.926777 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.927201 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:38.927206 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:38.927484 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:38.928864 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.928865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.928866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.929093 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.929326 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:38.929327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:38.929327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:38.929403 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:38.929688 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:38.929689 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:38.929738 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 07:16:38.929818 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:16:38.929921 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":80,"threads_started":1}
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:16:38 dist-test-slave-7f01 krb5kdc[11731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:38.953692 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.946911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58906 (local address 127.9.142.190:35747)
0811 07:16:38.946971 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.946973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.946983 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:16:38.947033 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.947034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.947051 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.947114 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:38.947779 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.948253 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.948999 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.949189 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.949262 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.951332 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:38.951333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:38.951334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:38.951343 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:38.952528 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.952879 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.952880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.952881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.952954 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:38.953158 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:38.953159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:38.953159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:38.953265 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:38.953375 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.953517 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.953594 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 07:16:38.955133 11823 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:16:38.956954 11823 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:38.963855 12721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.959253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:40939 (local address 127.0.0.1:59518)
0811 07:16:38.959362 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:38.959403 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:38.959477 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:38.960067 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:38.960070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:38.960073 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:38.960135 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.960137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.961233 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.961234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.962493 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.962495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.963465 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.963466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.963559 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.963574 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 07:16:38.963650 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 07:16:38.963699 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"mutex_wait_us":60,"thread_start_us":64,"threads_started":1}
I20260811 07:16:38.963888 12722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.959355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59518 (local address 127.9.142.129:40939)
0811 07:16:38.959861 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.959866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.959879 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:16:38.959922 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.959924 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.959940 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.960225 (+ 285us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:38.960300 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.961138 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.962583 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.963372 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.963457 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.963530 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.963682 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.963764 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":124,"threads_started":1}
I20260811 07:16:38.964040 12729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.959585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45306 (local address 127.9.142.130:45947)
0811 07:16:38.959827 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.959832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.959844 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:16:38.959889 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.959891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.959908 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.959992 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:38.960242 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.961073 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.962767 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.963435 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.963504 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.963553 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.963901 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.963942 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":116,"threads_started":1}
I20260811 07:16:38.964351 12723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.959464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:45947 (local address 127.0.0.1:45306)
0811 07:16:38.959594 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:38.959605 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:38.959664 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:38.960068 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:38.960076 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:38.960078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:38.960156 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.960159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.961153 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.961154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.962677 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.962681 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.963595 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.963596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.963676 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.963680 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:16:38.963733 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 07:16:38.963800 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":191,"thread_start_us":82,"threads_started":1}
I20260811 07:16:38.965135 12730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.959668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:36453 (local address 127.0.0.1:41042)
0811 07:16:38.960135 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:38.960145 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:38.960188 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:38.961567 (+ 1379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:38.961568 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:38.961570 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:38.961607 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.961609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.962896 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.962904 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.963875 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:38.963878 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.964921 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.964922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:38.964980 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.964985 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:16:38.965034 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 07:16:38.965074 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":233,"threads_started":1}
I20260811 07:16:38.965061 12062 tablet_service.cc:1467] Processing CreateTablet for tablet 90e54018807f4c82a471f7aa0ee1e516 (DEFAULT_TABLE table=test-table [id=c2833d619673401f9d1ae28d78e6cea5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:38.965138 12316 tablet_service.cc:1467] Processing CreateTablet for tablet 90e54018807f4c82a471f7aa0ee1e516 (DEFAULT_TABLE table=test-table [id=c2833d619673401f9d1ae28d78e6cea5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:38.965467 12731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:38.959907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41042 (local address 127.9.142.131:36453)
0811 07:16:38.961294 (+ 1387us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:38.961298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:38.961307 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:16:38.961345 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:38.961346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:38.961362 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:38.961452 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:38.961694 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.962809 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.964026 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:38.964757 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:38.964817 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:38.964867 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:38.965321 (+ 454us) server_negotiation.cc:299] Negotiation successful
0811 07:16:38.965365 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1351,"thread_start_us":94,"threads_started":1}
I20260811 07:16:38.965479 12316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90e54018807f4c82a471f7aa0ee1e516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:38.965481 12062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90e54018807f4c82a471f7aa0ee1e516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:38.968621 12732 tablet_bootstrap.cc:492] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: Bootstrap starting.
I20260811 07:16:38.968533 12567 tablet_service.cc:1467] Processing CreateTablet for tablet 90e54018807f4c82a471f7aa0ee1e516 (DEFAULT_TABLE table=test-table [id=c2833d619673401f9d1ae28d78e6cea5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:38.968881 12567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90e54018807f4c82a471f7aa0ee1e516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:38.968935 12736 tablet_bootstrap.cc:492] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: Bootstrap starting.
I20260811 07:16:38.969347 12732 tablet_bootstrap.cc:654] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:38.969599 12736 tablet_bootstrap.cc:654] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:38.969726 12732 log.cc:824] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:38.969990 12736 log.cc:824] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:38.970544 12732 tablet_bootstrap.cc:492] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: No bootstrap required, opened a new log
I20260811 07:16:38.970641 12732 ts_tablet_manager.cc:1397] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:16:38.970829 12736 tablet_bootstrap.cc:492] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: No bootstrap required, opened a new log
I20260811 07:16:38.970906 12736 ts_tablet_manager.cc:1397] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:16:38.972222 12732 raft_consensus.cc:348] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:38.972383 12742 tablet_bootstrap.cc:492] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: Bootstrap starting.
I20260811 07:16:38.972522 12732 raft_consensus.cc:374] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:38.972625 12732 raft_consensus.cc:729] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 393a1e05d38b4dba80921d40f30124f2, State: Initialized, Role: FOLLOWER
I20260811 07:16:38.972847 12732 consensus_queue.cc:260] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:38.973145 12736 raft_consensus.cc:348] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:38.973335 12742 tablet_bootstrap.cc:654] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:38.973352 12732 ts_tablet_manager.cc:1428] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:16:38.973354 12736 raft_consensus.cc:374] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:38.973408 12736 raft_consensus.cc:729] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4de3c93169456abaf0368b7558f313, State: Initialized, Role: FOLLOWER
I20260811 07:16:38.973415 12189 heartbeater.cc:503] Master 127.9.142.190:35747 was elected leader, sending a full tablet report...
I20260811 07:16:38.973603 12736 consensus_queue.cc:260] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:38.973794 12742 log.cc:824] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:38.973956 12736 ts_tablet_manager.cc:1428] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:16:38.974046 12448 heartbeater.cc:503] Master 127.9.142.190:35747 was elected leader, sending a full tablet report...
I20260811 07:16:38.974800 12742 tablet_bootstrap.cc:492] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: No bootstrap required, opened a new log
I20260811 07:16:38.974876 12742 ts_tablet_manager.cc:1397] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:16:38.976377 12742 raft_consensus.cc:348] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:38.976504 12742 raft_consensus.cc:374] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:38.976526 12742 raft_consensus.cc:729] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3cc1b7e8841b982c363e010b658a9, State: Initialized, Role: FOLLOWER
I20260811 07:16:38.976631 12742 consensus_queue.cc:260] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:38.976912 12742 ts_tablet_manager.cc:1428] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:16:38.976954 12688 heartbeater.cc:503] Master 127.9.142.190:35747 was elected leader, sending a full tablet report...
W20260811 07:16:39.007475 12449 tablet.cc:2369] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:16:39.082597 12190 tablet.cc:2369] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:16:39.163488 12744 raft_consensus.cc:482] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:39.163826 12744 raft_consensus.cc:504] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.164522 12744 leader_election.cc:288] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 393a1e05d38b4dba80921d40f30124f2 (127.9.142.129:40939), 34c3cc1b7e8841b982c363e010b658a9 (127.9.142.131:36453)
I20260811 07:16:39.167441 12255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.164739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:40939 (local address 127.9.142.130:54139)
0811 07:16:39.164803 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:39.164816 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:39.164866 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:39.165048 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:39.165050 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:39.165052 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:39.165134 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.165136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.165814 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.165815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.166572 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.166574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.167144 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.167145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.167244 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.167247 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:16:39.167321 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 07:16:39.167364 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 07:16:39.167441 12722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.164795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:54139 (local address 127.9.142.129:40939)
0811 07:16:39.164871 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:39.164873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:39.164890 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:16:39.164929 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:39.164930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:39.164941 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:39.165041 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:39.165215 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.165717 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.166674 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.167055 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.167145 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.167154 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:39.167341 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 07:16:39.167379 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:16:39.167814 12731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.165011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:36575 (local address 127.9.142.131:36453)
0811 07:16:39.165062 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:39.165064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:39.165191 (+ 127us) server_negotiation.cc:407] Connection header received
0811 07:16:39.165272 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:39.165273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:39.165281 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:39.165339 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:39.165525 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.165988 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.166951 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.167302 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.167483 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.167496 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:39.167675 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 07:16:39.167723 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 07:16:39.167867 12747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.164887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:36453 (local address 127.9.142.130:36575)
0811 07:16:39.165110 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:39.165127 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:39.165199 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:39.165358 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:39.165359 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:39.165360 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:39.165451 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.165453 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.166076 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.166077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.166831 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.166832 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.167497 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.167499 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.167588 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.167593 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:16:39.167667 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 07:16:39.167720 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":143,"threads_started":1}
I20260811 07:16:39.167855 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90e54018807f4c82a471f7aa0ee1e516" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "393a1e05d38b4dba80921d40f30124f2" is_pre_election: true
I20260811 07:16:39.168031 12108 raft_consensus.cc:2454] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 0.
I20260811 07:16:39.168195 12613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90e54018807f4c82a471f7aa0ee1e516" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3cc1b7e8841b982c363e010b658a9" is_pre_election: true
I20260811 07:16:39.168320 12230 leader_election.cc:302] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 393a1e05d38b4dba80921d40f30124f2, fa4de3c93169456abaf0368b7558f313; no voters:
I20260811 07:16:39.168381 12613 raft_consensus.cc:2454] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 0.
I20260811 07:16:39.168463 12744 raft_consensus.cc:2781] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:39.168562 12744 raft_consensus.cc:482] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:39.168591 12744 raft_consensus.cc:3037] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:39.169677 12744 raft_consensus.cc:504] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.169836 12744 leader_election.cc:288] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 election: Requested vote from peers 393a1e05d38b4dba80921d40f30124f2 (127.9.142.129:40939), 34c3cc1b7e8841b982c363e010b658a9 (127.9.142.131:36453)
I20260811 07:16:39.170050 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90e54018807f4c82a471f7aa0ee1e516" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "393a1e05d38b4dba80921d40f30124f2"
I20260811 07:16:39.170099 12613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90e54018807f4c82a471f7aa0ee1e516" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3cc1b7e8841b982c363e010b658a9"
I20260811 07:16:39.170150 12108 raft_consensus.cc:3037] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:39.170214 12613 raft_consensus.cc:3037] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Advancing to term 1
W20260811 07:16:39.170819 12689 tablet.cc:2369] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:16:39.170964 12108 raft_consensus.cc:2454] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 1.
I20260811 07:16:39.171121 12230 leader_election.cc:302] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 393a1e05d38b4dba80921d40f30124f2, fa4de3c93169456abaf0368b7558f313; no voters:
I20260811 07:16:39.171137 12613 raft_consensus.cc:2454] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 1.
I20260811 07:16:39.171238 12744 raft_consensus.cc:2781] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:39.171407 12744 raft_consensus.cc:686] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 1 LEADER]: Becoming Leader. State: Replica: fa4de3c93169456abaf0368b7558f313, State: Running, Role: LEADER
I20260811 07:16:39.171540 12744 consensus_queue.cc:237] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.172418 11823 catalog_manager.cc:5495] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4de3c93169456abaf0368b7558f313 (127.9.142.130). New cstate: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260811 07:16:39.191838 12729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.188783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45316 (local address 127.9.142.130:45947)
0811 07:16:39.188846 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:39.188848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:39.188858 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:16:39.188966 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:39.188967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:39.188989 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:39.189061 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:39.189260 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.189943 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.190937 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.191153 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.191231 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.191461 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:39.191569 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:39.191658 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:39.191713 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 07:16:39.191753 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 07:16:39.193753 12108 raft_consensus.cc:1261] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Refusing update from remote peer fa4de3c93169456abaf0368b7558f313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:39.193783 12613 raft_consensus.cc:1261] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Refusing update from remote peer fa4de3c93169456abaf0368b7558f313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:39.194104 12748 consensus_queue.cc:1035] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:39.194243 12744 consensus_queue.cc:1035] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:39.197341 12754 mvcc.cc:205] Tried to move back new op lower bound from 7317227926294605824 to 7317227926207270912. Current Snapshot: MvccSnapshot[applied={T|T < 7317227926294605824 or (T in {7317227926294605824})}]
I20260811 07:16:39.200641 11823 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:39.200737 11823 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:39.201520 11823 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a: Sending DeleteTablet for 3 replicas of tablet 90e54018807f4c82a471f7aa0ee1e516
I20260811 07:16:39.201887 12062 tablet_service.cc:1514] Processing DeleteTablet for tablet 90e54018807f4c82a471f7aa0ee1e516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:39 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:59518
I20260811 07:16:39.201930 12567 tablet_service.cc:1514] Processing DeleteTablet for tablet 90e54018807f4c82a471f7aa0ee1e516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:39 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:41042
I20260811 07:16:39.201902 12316 tablet_service.cc:1514] Processing DeleteTablet for tablet 90e54018807f4c82a471f7aa0ee1e516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:39 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:45306
I20260811 07:16:39.202178 12772 tablet_replica.cc:330] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: stopping tablet replica
I20260811 07:16:39.202287 12772 raft_consensus.cc:2229] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:16:39.202411 12772 raft_consensus.cc:2258] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:39.202448 12769 tablet_replica.cc:330] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: stopping tablet replica
I20260811 07:16:39.202436 11823 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:16:39.202575 11823 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:39.202623 12769 raft_consensus.cc:2229] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:39.202724 12769 raft_consensus.cc:2258] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:39.203090 12771 tablet_replica.cc:330] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: stopping tablet replica
I20260811 07:16:39.203197 12771 raft_consensus.cc:2229] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:39.203305 12771 raft_consensus.cc:2258] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:39.203737 12769 ts_tablet_manager.cc:1905] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:39.203868 12772 ts_tablet_manager.cc:1905] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:39.204133 12316 tablet_service.cc:1467] Processing CreateTablet for tablet 7284ed892cdb4d649a366860b5162510 (DEFAULT_TABLE table=test-table [id=2bcf54ccefbc449ca952237854e0f6e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:39.204239 12316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7284ed892cdb4d649a366860b5162510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:39.205005 12567 tablet_service.cc:1467] Processing CreateTablet for tablet 7284ed892cdb4d649a366860b5162510 (DEFAULT_TABLE table=test-table [id=2bcf54ccefbc449ca952237854e0f6e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:39.205124 12567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7284ed892cdb4d649a366860b5162510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:39.205475 12769 ts_tablet_manager.cc:1918] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:16:39.205547 12769 log.cc:1196] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/90e54018807f4c82a471f7aa0ee1e516
I20260811 07:16:39.205794 12769 ts_tablet_manager.cc:1939] T 90e54018807f4c82a471f7aa0ee1e516 P 393a1e05d38b4dba80921d40f30124f2: Deleting consensus metadata
I20260811 07:16:39.205948 12772 ts_tablet_manager.cc:1918] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:16:39.206018 12772 log.cc:1196] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/90e54018807f4c82a471f7aa0ee1e516
I20260811 07:16:39.206367 12772 ts_tablet_manager.cc:1939] T 90e54018807f4c82a471f7aa0ee1e516 P fa4de3c93169456abaf0368b7558f313: Deleting consensus metadata
I20260811 07:16:39.206743 12742 tablet_bootstrap.cc:492] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: Bootstrap starting.
I20260811 07:16:39.206795 11783 catalog_manager.cc:4841] TS fa4de3c93169456abaf0368b7558f313 (127.9.142.130:45947): tablet 90e54018807f4c82a471f7aa0ee1e516 (table test-table [id=c2833d619673401f9d1ae28d78e6cea5]) successfully deleted
I20260811 07:16:39.207000 12771 ts_tablet_manager.cc:1905] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:39.207218 12742 tablet_bootstrap.cc:654] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:39.207716 11783 catalog_manager.cc:4841] TS 393a1e05d38b4dba80921d40f30124f2 (127.9.142.129:40939): tablet 90e54018807f4c82a471f7aa0ee1e516 (table test-table [id=c2833d619673401f9d1ae28d78e6cea5]) successfully deleted
I20260811 07:16:39.207834 12742 tablet_bootstrap.cc:492] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: No bootstrap required, opened a new log
I20260811 07:16:39.207846 12062 tablet_service.cc:1467] Processing CreateTablet for tablet 7284ed892cdb4d649a366860b5162510 (DEFAULT_TABLE table=test-table [id=2bcf54ccefbc449ca952237854e0f6e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:39.207890 12742 ts_tablet_manager.cc:1397] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:39.207942 12062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7284ed892cdb4d649a366860b5162510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:39.208045 12742 raft_consensus.cc:348] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.208106 12742 raft_consensus.cc:374] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:39.208125 12742 raft_consensus.cc:729] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3cc1b7e8841b982c363e010b658a9, State: Initialized, Role: FOLLOWER
I20260811 07:16:39.208168 12742 consensus_queue.cc:260] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.208244 12742 ts_tablet_manager.cc:1428] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:39.208539 12771 ts_tablet_manager.cc:1918] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:16:39.208607 12771 log.cc:1196] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/90e54018807f4c82a471f7aa0ee1e516
I20260811 07:16:39.208863 12771 ts_tablet_manager.cc:1939] T 90e54018807f4c82a471f7aa0ee1e516 P 34c3cc1b7e8841b982c363e010b658a9: Deleting consensus metadata
I20260811 07:16:39.208961 12732 tablet_bootstrap.cc:492] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: Bootstrap starting.
I20260811 07:16:39.209394 12732 tablet_bootstrap.cc:654] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:39.209445 11783 catalog_manager.cc:4841] TS 34c3cc1b7e8841b982c363e010b658a9 (127.9.142.131:36453): tablet 90e54018807f4c82a471f7aa0ee1e516 (table test-table [id=c2833d619673401f9d1ae28d78e6cea5]) successfully deleted
I20260811 07:16:39.210213 12732 tablet_bootstrap.cc:492] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: No bootstrap required, opened a new log
I20260811 07:16:39.210266 12732 ts_tablet_manager.cc:1397] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:39.210400 12736 tablet_bootstrap.cc:492] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: Bootstrap starting.
I20260811 07:16:39.210400 12732 raft_consensus.cc:348] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.210462 12732 raft_consensus.cc:374] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:39.210484 12732 raft_consensus.cc:729] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 393a1e05d38b4dba80921d40f30124f2, State: Initialized, Role: FOLLOWER
I20260811 07:16:39.210525 12732 consensus_queue.cc:260] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.210620 12732 ts_tablet_manager.cc:1428] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:39.210911 12736 tablet_bootstrap.cc:654] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:39.211568 12736 tablet_bootstrap.cc:492] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: No bootstrap required, opened a new log
I20260811 07:16:39.211622 12736 ts_tablet_manager.cc:1397] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:39.211799 12736 raft_consensus.cc:348] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.211863 12736 raft_consensus.cc:374] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:39.211877 12736 raft_consensus.cc:729] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4de3c93169456abaf0368b7558f313, State: Initialized, Role: FOLLOWER
I20260811 07:16:39.211910 12736 consensus_queue.cc:260] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.211992 12736 ts_tablet_manager.cc:1428] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:39.283491 12744 raft_consensus.cc:482] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:39.283591 12744 raft_consensus.cc:504] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.283923 12744 leader_election.cc:288] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 393a1e05d38b4dba80921d40f30124f2 (127.9.142.129:40939), 34c3cc1b7e8841b982c363e010b658a9 (127.9.142.131:36453)
I20260811 07:16:39.284142 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7284ed892cdb4d649a366860b5162510" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "393a1e05d38b4dba80921d40f30124f2" is_pre_election: true
I20260811 07:16:39.284183 12613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7284ed892cdb4d649a366860b5162510" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3cc1b7e8841b982c363e010b658a9" is_pre_election: true
I20260811 07:16:39.284269 12108 raft_consensus.cc:2454] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 0.
I20260811 07:16:39.284291 12613 raft_consensus.cc:2454] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 0.
I20260811 07:16:39.284474 12230 leader_election.cc:302] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3cc1b7e8841b982c363e010b658a9, fa4de3c93169456abaf0368b7558f313; no voters:
I20260811 07:16:39.284595 12744 raft_consensus.cc:2781] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:39.284638 12744 raft_consensus.cc:482] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:39.284682 12744 raft_consensus.cc:3037] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:39.285439 12744 raft_consensus.cc:504] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.285607 12744 leader_election.cc:288] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 election: Requested vote from peers 393a1e05d38b4dba80921d40f30124f2 (127.9.142.129:40939), 34c3cc1b7e8841b982c363e010b658a9 (127.9.142.131:36453)
I20260811 07:16:39.285830 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7284ed892cdb4d649a366860b5162510" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "393a1e05d38b4dba80921d40f30124f2"
I20260811 07:16:39.285840 12613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7284ed892cdb4d649a366860b5162510" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3cc1b7e8841b982c363e010b658a9"
I20260811 07:16:39.285921 12613 raft_consensus.cc:3037] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:39.285928 12108 raft_consensus.cc:3037] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:39.286779 12613 raft_consensus.cc:2454] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 1.
I20260811 07:16:39.286980 12230 leader_election.cc:302] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3cc1b7e8841b982c363e010b658a9, fa4de3c93169456abaf0368b7558f313; no voters:
I20260811 07:16:39.287083 12744 raft_consensus.cc:2781] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:39.287148 12744 raft_consensus.cc:686] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 1 LEADER]: Becoming Leader. State: Replica: fa4de3c93169456abaf0368b7558f313, State: Running, Role: LEADER
I20260811 07:16:39.287194 12108 raft_consensus.cc:2454] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 1.
I20260811 07:16:39.287199 12744 consensus_queue.cc:237] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.287855 11823 catalog_manager.cc:5495] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4de3c93169456abaf0368b7558f313 (127.9.142.130). New cstate: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } health_report { overall_health: UNKNOWN } } }
Aug 11 07:16:39 dist-test-slave-7f01 krb5kdc[11731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:39.320362 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.312553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58916 (local address 127.9.142.190:35747)
0811 07:16:39.312604 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:39.312607 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:39.312718 (+ 111us) server_negotiation.cc:407] Connection header received
0811 07:16:39.312785 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:39.312785 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:39.312794 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:39.312860 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:39.313405 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.313915 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.314975 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.315162 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.315228 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.317595 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:39.317596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:39.317597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:39.317604 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:39.319092 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:39.319491 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:39.319492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:39.319493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:39.319554 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:39.319775 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:39.319776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:39.319776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:39.319891 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:39.319970 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:39.320128 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 07:16:39.320241 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 07:16:39.320425 12788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.312460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35747 (local address 127.0.0.1:58916)
0811 07:16:39.312638 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:39.312651 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:39.312726 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:39.312873 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:39.312874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:39.313264 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:39.313332 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.313334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.313987 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.313988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.314872 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.314874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.315244 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.315245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.315310 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.315956 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:39.315961 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:39.317499 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:39.319197 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:39.319205 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:39.319208 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:39.319413 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:39.319628 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:39.319629 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:39.319629 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:39.319692 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:39.319959 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:39.319967 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:39.320014 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 07:16:39.320103 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 07:16:39.320302 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":94,"thread_start_us":92,"threads_started":1}
I20260811 07:16:39.322566 11823 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:58916:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:16:39.322855 11823 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:39.324627 12316 tablet_service.cc:1467] Processing CreateTablet for tablet d1e0ce7b671f487e9bd6156050c8f59a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bbcad6d77e66403b91b5976ffd5ab4ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:16:39.324792 12062 tablet_service.cc:1467] Processing CreateTablet for tablet d1e0ce7b671f487e9bd6156050c8f59a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bbcad6d77e66403b91b5976ffd5ab4ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:16:39.324887 12316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1e0ce7b671f487e9bd6156050c8f59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:39.325004 12062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1e0ce7b671f487e9bd6156050c8f59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:39.326398 12736 tablet_bootstrap.cc:492] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: Bootstrap starting.
I20260811 07:16:39.326656 12732 tablet_bootstrap.cc:492] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: Bootstrap starting.
I20260811 07:16:39.326757 12736 tablet_bootstrap.cc:654] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:39.326738 12567 tablet_service.cc:1467] Processing CreateTablet for tablet d1e0ce7b671f487e9bd6156050c8f59a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bbcad6d77e66403b91b5976ffd5ab4ce]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:16:39.326920 12567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1e0ce7b671f487e9bd6156050c8f59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:39.327155 12732 tablet_bootstrap.cc:654] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:39.327387 12736 tablet_bootstrap.cc:492] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: No bootstrap required, opened a new log
I20260811 07:16:39.327431 12736 ts_tablet_manager.cc:1397] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:39.327536 12736 raft_consensus.cc:348] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.327615 12736 raft_consensus.cc:374] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:39.327651 12736 raft_consensus.cc:729] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4de3c93169456abaf0368b7558f313, State: Initialized, Role: FOLLOWER
I20260811 07:16:39.327685 12736 consensus_queue.cc:260] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.327819 12736 ts_tablet_manager.cc:1428] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:39.327877 12732 tablet_bootstrap.cc:492] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: No bootstrap required, opened a new log
I20260811 07:16:39.327924 12732 ts_tablet_manager.cc:1397] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:39.328115 12732 raft_consensus.cc:348] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.328194 12732 raft_consensus.cc:374] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:39.328226 12732 raft_consensus.cc:729] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 393a1e05d38b4dba80921d40f30124f2, State: Initialized, Role: FOLLOWER
I20260811 07:16:39.328264 12732 consensus_queue.cc:260] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.328353 12732 ts_tablet_manager.cc:1428] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:39.328483 12743 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.328570 12743 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:39.328580 12742 tablet_bootstrap.cc:492] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: Bootstrap starting.
I20260811 07:16:39.328591 12744 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.328691 12744 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:39.329105 12742 tablet_bootstrap.cc:654] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:39.329843 12742 tablet_bootstrap.cc:492] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: No bootstrap required, opened a new log
I20260811 07:16:39.329901 12742 ts_tablet_manager.cc:1397] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:39.330078 12742 raft_consensus.cc:348] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.330154 12742 raft_consensus.cc:374] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:39.330184 12742 raft_consensus.cc:729] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34c3cc1b7e8841b982c363e010b658a9, State: Initialized, Role: FOLLOWER
I20260811 07:16:39.330235 12742 consensus_queue.cc:260] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.330330 12742 ts_tablet_manager.cc:1428] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 07:16:39.330484 12746 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.330580 12746 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:39.339861 12744 raft_consensus.cc:482] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:39.339936 12744 raft_consensus.cc:504] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.340093 12744 leader_election.cc:288] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 393a1e05d38b4dba80921d40f30124f2 (127.9.142.129:40939), 34c3cc1b7e8841b982c363e010b658a9 (127.9.142.131:36453)
I20260811 07:16:39.340296 12613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e0ce7b671f487e9bd6156050c8f59a" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3cc1b7e8841b982c363e010b658a9" is_pre_election: true
I20260811 07:16:39.340288 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e0ce7b671f487e9bd6156050c8f59a" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "393a1e05d38b4dba80921d40f30124f2" is_pre_election: true
I20260811 07:16:39.340391 12613 raft_consensus.cc:2454] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 0.
I20260811 07:16:39.340389 12108 raft_consensus.cc:2454] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 0.
I20260811 07:16:39.340533 12230 leader_election.cc:302] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34c3cc1b7e8841b982c363e010b658a9, fa4de3c93169456abaf0368b7558f313; no voters:
I20260811 07:16:39.340636 12744 raft_consensus.cc:2781] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:39.340701 12744 raft_consensus.cc:482] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:39.340732 12744 raft_consensus.cc:3037] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:39.341369 12744 raft_consensus.cc:504] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.341499 12744 leader_election.cc:288] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 election: Requested vote from peers 393a1e05d38b4dba80921d40f30124f2 (127.9.142.129:40939), 34c3cc1b7e8841b982c363e010b658a9 (127.9.142.131:36453)
I20260811 07:16:39.341643 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e0ce7b671f487e9bd6156050c8f59a" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "393a1e05d38b4dba80921d40f30124f2"
I20260811 07:16:39.341722 12108 raft_consensus.cc:3037] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:39.341682 12613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e0ce7b671f487e9bd6156050c8f59a" candidate_uuid: "fa4de3c93169456abaf0368b7558f313" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34c3cc1b7e8841b982c363e010b658a9"
I20260811 07:16:39.341774 12613 raft_consensus.cc:3037] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:39.342278 12613 raft_consensus.cc:2454] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 1.
I20260811 07:16:39.342301 12108 raft_consensus.cc:2454] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4de3c93169456abaf0368b7558f313 in term 1.
I20260811 07:16:39.342502 12230 leader_election.cc:302] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 393a1e05d38b4dba80921d40f30124f2, fa4de3c93169456abaf0368b7558f313; no voters:
I20260811 07:16:39.342609 12744 raft_consensus.cc:2781] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:39.342675 12744 raft_consensus.cc:686] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [term 1 LEADER]: Becoming Leader. State: Replica: fa4de3c93169456abaf0368b7558f313, State: Running, Role: LEADER
I20260811 07:16:39.342721 12744 consensus_queue.cc:237] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } }
I20260811 07:16:39.343021 12757 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: TxnStatusTablet state changed. Reason: New leader fa4de3c93169456abaf0368b7558f313. Latest consensus state: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.343122 12757 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:16:39.343302 12796 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:16:39.343277 11823 catalog_manager.cc:5495] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4de3c93169456abaf0368b7558f313 (127.9.142.130). New cstate: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } health_report { overall_health: UNKNOWN } } }
I20260811 07:16:39.343410 12796 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:16:39.351097 12729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.348544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45318 (local address 127.9.142.130:45947)
0811 07:16:39.348587 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:39.348589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:39.348635 (+ 46us) server_negotiation.cc:407] Connection header received
0811 07:16:39.348721 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:39.348722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:39.348731 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:39.348774 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:39.348897 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.349380 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.350440 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.350617 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.350667 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.350870 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:39.350895 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:39.350929 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:39.351029 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 07:16:39.351048 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:16:39.351152 12788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.348503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:45947 (local address 127.0.0.1:45318)
0811 07:16:39.348589 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:39.348600 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:39.348654 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:39.348790 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:39.348791 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:39.348792 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:16:39.348842 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.348844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.349445 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.349446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.350353 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.350356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.350691 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.350692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.350763 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.350781 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:16:39.350961 (+ 180us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:16:39.350970 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 07:16:39.351027 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 07:16:39.351078 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 07:16:39.352046 12613 raft_consensus.cc:1261] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Refusing update from remote peer fa4de3c93169456abaf0368b7558f313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:39.352061 12108 raft_consensus.cc:1261] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Refusing update from remote peer fa4de3c93169456abaf0368b7558f313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:39.352267 12757 consensus_queue.cc:1035] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:39.352371 12744 consensus_queue.cc:1035] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:39.352946 12746 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: TxnStatusTablet state changed. Reason: New leader fa4de3c93169456abaf0368b7558f313. Latest consensus state: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.353047 12746 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:39.353449 12743 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: TxnStatusTablet state changed. Reason: New leader fa4de3c93169456abaf0368b7558f313. Latest consensus state: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.353528 12743 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:39.353884 12757 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.353969 12757 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:16:39.353919 12748 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.354007 12748 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P fa4de3c93169456abaf0368b7558f313: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:16:39.354035 12751 mvcc.cc:205] Tried to move back new op lower bound from 7317227926944575488 to 7317227926908280832. Current Snapshot: MvccSnapshot[applied={T|T < 7317227926944575488}]
I20260811 07:16:39.354285 12743 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.354360 12743 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P 393a1e05d38b4dba80921d40f30124f2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:39.355381 12746 tablet_replica.cc:439] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fa4de3c93169456abaf0368b7558f313" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 } } peers { permanent_uuid: "fa4de3c93169456abaf0368b7558f313" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45947 } } peers { permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 } } }
I20260811 07:16:39.355461 12746 tablet_replica.cc:442] T d1e0ce7b671f487e9bd6156050c8f59a P 34c3cc1b7e8841b982c363e010b658a9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:39.361065 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.358467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:45947 (local address 127.9.142.130:38343)
0811 07:16:39.358640 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:39.358649 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:39.358735 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:39.358849 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:39.358850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:39.358852 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:16:39.358891 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.358893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.359548 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.359549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.360230 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:39.360232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.360615 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.360617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:39.360666 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.360689 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:16:39.360913 (+ 224us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:16:39.360914 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 07:16:39.360958 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 07:16:39.360997 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":101,"threads_started":1}
I20260811 07:16:39.361111 12729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.358491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:38343 (local address 127.9.142.130:45947)
0811 07:16:39.358530 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:39.358532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:39.358720 (+ 188us) server_negotiation.cc:407] Connection header received
0811 07:16:39.358781 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:39.358783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:39.358792 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:39.358845 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:39.358938 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.359460 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.360315 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.360519 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.360593 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.360783 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:39.360819 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:39.360895 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:39.360980 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 07:16:39.361003 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:16:39.363171 12108 raft_consensus.cc:1261] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Refusing update from remote peer fa4de3c93169456abaf0368b7558f313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:39.363171 12613 raft_consensus.cc:1261] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Refusing update from remote peer fa4de3c93169456abaf0368b7558f313: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:39.363382 12744 consensus_queue.cc:1035] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "393a1e05d38b4dba80921d40f30124f2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:39.363462 12757 consensus_queue.cc:1035] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34c3cc1b7e8841b982c363e010b658a9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:39.365082 12752 mvcc.cc:205] Tried to move back new op lower bound from 7317227926990266368 to 7317227926680788992. Current Snapshot: MvccSnapshot[applied={T|T < 7317227926990266368}]
I20260811 07:16:39.376004 11823 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:39.376101 11823 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:39.376713 11823 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd5e8437891e47e3834c556cbba19b7a: Sending DeleteTablet for 3 replicas of tablet 7284ed892cdb4d649a366860b5162510
I20260811 07:16:39.377063 12062 tablet_service.cc:1514] Processing DeleteTablet for tablet 7284ed892cdb4d649a366860b5162510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:39 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:59518
I20260811 07:16:39.377099 12567 tablet_service.cc:1514] Processing DeleteTablet for tablet 7284ed892cdb4d649a366860b5162510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:39 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:41042
I20260811 07:16:39.377197 12769 tablet_replica.cc:330] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: stopping tablet replica
I20260811 07:16:39.377269 12769 raft_consensus.cc:2229] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:39.377315 12769 raft_consensus.cc:2258] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:39.377393 12771 tablet_replica.cc:330] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: stopping tablet replica
I20260811 07:16:39.377442 12771 raft_consensus.cc:2229] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:39.377489 12771 raft_consensus.cc:2258] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:39.377482 12316 tablet_service.cc:1514] Processing DeleteTablet for tablet 7284ed892cdb4d649a366860b5162510 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:39 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:45306
I20260811 07:16:39.377624 12772 tablet_replica.cc:330] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: stopping tablet replica
I20260811 07:16:39.377650 12769 ts_tablet_manager.cc:1905] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:39.377693 12772 raft_consensus.cc:2229] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:16:39.377741 12772 raft_consensus.cc:2258] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:39.378039 12771 ts_tablet_manager.cc:1905] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:39.378122 12772 ts_tablet_manager.cc:1905] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:39.379420 12769 ts_tablet_manager.cc:1918] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:16:39.379474 12769 log.cc:1196] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/7284ed892cdb4d649a366860b5162510
I20260811 07:16:39.379462 12772 ts_tablet_manager.cc:1918] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:16:39.379516 12772 log.cc:1196] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/7284ed892cdb4d649a366860b5162510
I20260811 07:16:39.379699 12772 ts_tablet_manager.cc:1939] T 7284ed892cdb4d649a366860b5162510 P fa4de3c93169456abaf0368b7558f313: Deleting consensus metadata
I20260811 07:16:39.379719 12769 ts_tablet_manager.cc:1939] T 7284ed892cdb4d649a366860b5162510 P 393a1e05d38b4dba80921d40f30124f2: Deleting consensus metadata
I20260811 07:16:39.379761 12771 ts_tablet_manager.cc:1918] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:16:39.379815 12771 log.cc:1196] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/7284ed892cdb4d649a366860b5162510
I20260811 07:16:39.380026 12771 ts_tablet_manager.cc:1939] T 7284ed892cdb4d649a366860b5162510 P 34c3cc1b7e8841b982c363e010b658a9: Deleting consensus metadata
I20260811 07:16:39.380084 11783 catalog_manager.cc:4841] TS 393a1e05d38b4dba80921d40f30124f2 (127.9.142.129:40939): tablet 7284ed892cdb4d649a366860b5162510 (table test-table [id=2bcf54ccefbc449ca952237854e0f6e1]) successfully deleted
I20260811 07:16:39.380157 11783 catalog_manager.cc:4841] TS fa4de3c93169456abaf0368b7558f313 (127.9.142.130:45947): tablet 7284ed892cdb4d649a366860b5162510 (table test-table [id=2bcf54ccefbc449ca952237854e0f6e1]) successfully deleted
I20260811 07:16:39.380326 11783 catalog_manager.cc:4841] TS 34c3cc1b7e8841b982c363e010b658a9 (127.9.142.131:36453): tablet 7284ed892cdb4d649a366860b5162510 (table test-table [id=2bcf54ccefbc449ca952237854e0f6e1]) successfully deleted
Aug 11 07:16:39 dist-test-slave-7f01 krb5kdc[11731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:16:39.388414 12722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.379865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59522 (local address 127.9.142.129:40939)
0811 07:16:39.379907 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:39.379909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:39.379918 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:16:39.379940 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:39.379941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:39.379950 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:39.380014 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:39.380845 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.381319 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.382054 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.382246 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.382322 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.385420 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:39.385431 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:39.385431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:39.385445 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:39.387108 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:39.387488 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:39.387491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:39.387491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:39.387584 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:39.387831 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:39.387832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:39.387832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:39.388040 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:39.388195 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:39.388237 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 07:16:39.388325 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 07:16:39.388664 12180 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59522
I20260811 07:16:39.396183 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:39.389752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58922 (local address 127.9.142.190:35747)
0811 07:16:39.389804 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:39.389805 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:39.389976 (+ 171us) server_negotiation.cc:407] Connection header received
0811 07:16:39.390074 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:39.390075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:39.390085 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:39.390117 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:39.390651 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.391421 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.392143 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:39.392446 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:39.392516 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:39.393595 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:39.393597 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:39.393597 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:39.393604 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:39.395108 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:39.395425 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:39.395426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:39.395427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:39.395489 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:39.395673 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:39.395674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:39.395675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:39.395828 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:39.395941 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:39.396015 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 07:16:39.396091 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 07:16:39.396500 11823 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58922
I20260811 07:16:39.397176 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 11953
I20260811 07:16:39.431819 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 12200
I20260811 07:16:39.444170 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 12466
I20260811 07:16:39.460016 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 11755
2026-08-11T07:16:39Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2613 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:39 dist-test-slave-7f01 krb5kdc[12823](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:39 dist-test-slave-7f01 krb5kdc[12823](info): set up 2 sockets
Aug 11 07:16:39 dist-test-slave-7f01 krb5kdc[12823](info): commencing operation
krb5kdc: starting...
W20260811 07:16:40.743616 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:40 dist-test-slave-7f01 krb5kdc[12823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:16:40.866972 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:38945
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:38945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:40.950366 12846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:40.950565 12846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:40.950587 12846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:40.951645 12846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:40.951679 12846 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:16:40.951692 12846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:40.951705 12846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:40.951719 12846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:40.951731 12846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:40.953276 12846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:38945
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:38945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:40.953476 12846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:40.953646 12846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:40.958541 12853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:40.958652 12846 server_base.cc:1034] running on GCE node
W20260811 07:16:40.958738 12859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:40.958551 12861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:40.959076 12846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:40.959394 12846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:40.960749 12846 hybrid_clock.cc:648] HybridClock initialized: now 1786432600960742 us; error 37 us; skew 500 ppm
Aug 11 07:16:40 dist-test-slave-7f01 krb5kdc[12823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432600, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:40.963359 12846 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:16:40.963959 12846 webserver.cc:460] Webserver started at http://127.9.142.190:38289/ using document root <none> and password file <none>
I20260811 07:16:40.964213 12846 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:40.964283 12846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:40.964437 12846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:40.965508 12846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "f7aff7cd415244429d4dd92f02945d9d"
format_stamp: "Formatted at 2026-08-11 07:16:40 on dist-test-slave-7f01"
server_key: "b8de696a4a4b68b88cfe87bb29de0730"
server_key_iv: "6ce87ff1e68136397a0db2f08de81a23"
server_key_version: "encryptionkey@0"
I20260811 07:16:40.965898 12846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "f7aff7cd415244429d4dd92f02945d9d"
format_stamp: "Formatted at 2026-08-11 07:16:40 on dist-test-slave-7f01"
server_key: "b8de696a4a4b68b88cfe87bb29de0730"
server_key_iv: "6ce87ff1e68136397a0db2f08de81a23"
server_key_version: "encryptionkey@0"
I20260811 07:16:40.967274 12846 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:16:40.968077 12881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:40.968255 12846 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:40.968364 12846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "f7aff7cd415244429d4dd92f02945d9d"
format_stamp: "Formatted at 2026-08-11 07:16:40 on dist-test-slave-7f01"
server_key: "b8de696a4a4b68b88cfe87bb29de0730"
server_key_iv: "6ce87ff1e68136397a0db2f08de81a23"
server_key_version: "encryptionkey@0"
I20260811 07:16:40.968444 12846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:40.986688 12846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:40.988752 12846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:40.988916 12846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:40.994114 12846 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:38945
I20260811 07:16:40.994174 12983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:38945 every 8 connection(s)
I20260811 07:16:40.994486 12846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:40.995085 12985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:40.997450 12985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: Bootstrap starting.
I20260811 07:16:40.998055 12985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:40.998354 12985 log.cc:824] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:40.999050 12985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: No bootstrap required, opened a new log
I20260811 07:16:41.001332 12985 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7aff7cd415244429d4dd92f02945d9d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 38945 } }
I20260811 07:16:41.001508 12985 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.001559 12985 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7aff7cd415244429d4dd92f02945d9d, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.001722 12985 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7aff7cd415244429d4dd92f02945d9d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 38945 } }
I20260811 07:16:41.001823 12985 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:41.001868 12985 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:41.001922 12985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:41.001907 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 12846
I20260811 07:16:41.002017 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:41.002213 9786 external_mini_cluster.cc:1428] Setting key 92f4434060614292a6d4ad9103f42d1a
I20260811 07:16:41.002549 12985 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7aff7cd415244429d4dd92f02945d9d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 38945 } }
I20260811 07:16:41.002673 12985 leader_election.cc:302] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7aff7cd415244429d4dd92f02945d9d; no voters:
I20260811 07:16:41.002897 12985 leader_election.cc:288] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:41.002933 12993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:41.003113 12993 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [term 1 LEADER]: Becoming Leader. State: Replica: f7aff7cd415244429d4dd92f02945d9d, State: Running, Role: LEADER
I20260811 07:16:41.003191 12985 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:41.003264 12993 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7aff7cd415244429d4dd92f02945d9d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 38945 } }
I20260811 07:16:41.004567 12994 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7aff7cd415244429d4dd92f02945d9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7aff7cd415244429d4dd92f02945d9d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 38945 } } }
I20260811 07:16:41.004573 12996 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7aff7cd415244429d4dd92f02945d9d. Latest consensus state: current_term: 1 leader_uuid: "f7aff7cd415244429d4dd92f02945d9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7aff7cd415244429d4dd92f02945d9d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 38945 } } }
I20260811 07:16:41.004777 12994 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:41.004789 12996 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d [sys.catalog]: This master's current role is: LEADER
W20260811 07:16:41.005411 13021 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:16:41.005491 13021 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:16:41.005581 13022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:41.005811 13022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:41.007524 13022 catalog_manager.cc:1347] Generated new cluster ID: 229b5bda1fdf4e5eb4ff8df60e00179d
I20260811 07:16:41.007619 13022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:41.014192 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.002702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49132 (local address 127.9.142.190:38945)
0811 07:16:41.002866 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.002892 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.002931 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:16:41.003060 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.003068 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.003127 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.003271 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:41.004105 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.005559 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.006299 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.006924 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.007047 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.009878 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:41.009882 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:41.009882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:41.009894 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:41.012520 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.012919 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.012922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.012922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.013053 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.013273 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.013273 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.013274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.013593 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:41.013762 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.013841 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.013980 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260811 07:16:41.031297 13022 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:41.031891 13022 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:41.038664 13022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: Generated new TSK 0
I20260811 07:16:41.038866 13022 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:16:41.066565 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:38945
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:41.150465 13034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:41.150689 13034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:41.150731 13034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:41.151878 13034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:41.151949 13034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:41.151983 13034 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:16:41.152014 13034 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:16:41.152047 13034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:16:41.153489 13034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.142.190:38945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:41.153784 13034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:41.154021 13034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:41.158900 13043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:41.158913 13042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:41.159138 13034 server_base.cc:1034] running on GCE node
W20260811 07:16:41.159190 13046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:41.159404 13034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:41.159657 13034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:41.160807 13034 hybrid_clock.cc:648] HybridClock initialized: now 1786432601160797 us; error 32 us; skew 500 ppm
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432601, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:41.163368 13034 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:16:41.163842 13034 webserver.cc:460] Webserver started at http://127.9.142.129:39043/ using document root <none> and password file <none>
I20260811 07:16:41.164083 13034 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:41.164152 13034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:41.164319 13034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:41.165299 13034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "03d6ced1cfcb4ce3b454b547e23f4a71"
format_stamp: "Formatted at 2026-08-11 07:16:41 on dist-test-slave-7f01"
server_key: "aa20373158a0e79369d34a3ce27484b7"
server_key_iv: "cb9f87f1205785e567e0af0d216b82ec"
server_key_version: "encryptionkey@0"
I20260811 07:16:41.165669 13034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "03d6ced1cfcb4ce3b454b547e23f4a71"
format_stamp: "Formatted at 2026-08-11 07:16:41 on dist-test-slave-7f01"
server_key: "aa20373158a0e79369d34a3ce27484b7"
server_key_iv: "cb9f87f1205785e567e0af0d216b82ec"
server_key_version: "encryptionkey@0"
I20260811 07:16:41.166994 13034 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:41.167779 13058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.167986 13034 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:41.168092 13034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "03d6ced1cfcb4ce3b454b547e23f4a71"
format_stamp: "Formatted at 2026-08-11 07:16:41 on dist-test-slave-7f01"
server_key: "aa20373158a0e79369d34a3ce27484b7"
server_key_iv: "cb9f87f1205785e567e0af0d216b82ec"
server_key_version: "encryptionkey@0"
I20260811 07:16:41.168181 13034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:41.185768 13034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:41.188174 13034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:41.188359 13034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:41.188870 13034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:41.188936 13034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.189033 13034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:41.189067 13034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432601, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:41.196796 13034 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:34351
I20260811 07:16:41.196907 13261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:34351 every 8 connection(s)
I20260811 07:16:41.197196 13034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:16:41.199697 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.189430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:59395 (local address 127.9.142.190:38945)
0811 07:16:41.189514 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.189517 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.189706 (+ 189us) server_negotiation.cc:407] Connection header received
0811 07:16:41.190188 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.190189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.190204 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.190285 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:41.190964 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.191845 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.192869 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.193207 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.193282 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.196606 (+ 3324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:41.196607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:41.196608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:41.196616 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:41.198258 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.198670 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.198671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.198671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.198735 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.199004 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.199005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.199005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.199128 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:41.199209 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.199503 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.199603 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:16:41.199879 13070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.189392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:38945 (local address 127.9.142.129:59395)
0811 07:16:41.189568 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.189607 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.190080 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.190357 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.190360 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.190586 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:41.190836 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.190844 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.191959 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.191960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.192770 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.192772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.193313 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.193315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.193499 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.194098 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:41.194110 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:41.196502 (+ 2392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:41.198349 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.198357 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.198360 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.198589 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.198819 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.198820 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.198820 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.198931 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.199199 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:41.199207 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:41.199358 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.199463 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.199623 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260811 07:16:41.200435 13262 heartbeater.cc:347] Connected to a master server at 127.9.142.190:38945
I20260811 07:16:41.200515 13262 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:41.200708 13262 heartbeater.cc:511] Master 127.9.142.190:38945 requested a full tablet report, sending...
I20260811 07:16:41.201273 12904 ts_manager.cc:194] Registered new tserver with Master: 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351)
I20260811 07:16:41.201853 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 13034
I20260811 07:16:41.201968 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:16:41.202157 9786 external_mini_cluster.cc:1428] Setting key 800a1d1b728acdb943f96016c85eae9d
I20260811 07:16:41.202176 12904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:59395
I20260811 07:16:41.207281 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.201620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:35377 (local address 127.9.142.190:38945)
0811 07:16:41.201662 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.201664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.201761 (+ 97us) server_negotiation.cc:407] Connection header received
0811 07:16:41.201874 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.201875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.201884 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.201911 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:41.202319 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.202965 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.203764 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.203970 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.204048 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.204918 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:41.204919 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:41.204920 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:41.204927 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:41.206154 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.206547 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.206548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.206548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.206602 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.206857 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.206858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.206858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.206955 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:41.207007 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.207166 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.207226 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:16:41.207402 13271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.201536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:38945 (local address 127.9.142.129:35377)
0811 07:16:41.201680 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.201708 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.201786 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.201963 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.201964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.202164 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:41.202226 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.202228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.203061 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.203062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.203656 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.203658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.204048 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.204049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.204126 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.204556 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:41.204560 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:41.204828 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:41.206241 (+ 1413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.206242 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.206243 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.206469 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.206674 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.206675 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.206675 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.206750 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.207022 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:41.207023 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:41.207075 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.207148 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.207262 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:16:41.230332 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:38945
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:41.313422 13274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:41.313663 13274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:41.313701 13274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:41.314819 13274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:41.314889 13274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:41.314924 13274 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:16:41.314954 13274 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:16:41.314985 13274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:16:41.316449 13274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.142.190:38945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:41.316730 13274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:41.316972 13274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:41.322144 13279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:41.322157 13282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:41.322185 13280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:41.322186 13274 server_base.cc:1034] running on GCE node
I20260811 07:16:41.322536 13274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:41.322800 13274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:41.323971 13274 hybrid_clock.cc:648] HybridClock initialized: now 1786432601323966 us; error 39 us; skew 500 ppm
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432601, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:41.326409 13274 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:16:41.326843 13274 webserver.cc:460] Webserver started at http://127.9.142.130:35039/ using document root <none> and password file <none>
I20260811 07:16:41.327092 13274 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:41.327164 13274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:41.327313 13274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:41.328373 13274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34"
format_stamp: "Formatted at 2026-08-11 07:16:41 on dist-test-slave-7f01"
server_key: "89b8eb579c191baef2a354b1cff6667f"
server_key_iv: "f1886c6bb708abb2b4fe0b4c9cbac304"
server_key_version: "encryptionkey@0"
I20260811 07:16:41.328728 13274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34"
format_stamp: "Formatted at 2026-08-11 07:16:41 on dist-test-slave-7f01"
server_key: "89b8eb579c191baef2a354b1cff6667f"
server_key_iv: "f1886c6bb708abb2b4fe0b4c9cbac304"
server_key_version: "encryptionkey@0"
I20260811 07:16:41.330053 13274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:16:41.330824 13293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.331013 13274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:41.331126 13274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34"
format_stamp: "Formatted at 2026-08-11 07:16:41 on dist-test-slave-7f01"
server_key: "89b8eb579c191baef2a354b1cff6667f"
server_key_iv: "f1886c6bb708abb2b4fe0b4c9cbac304"
server_key_version: "encryptionkey@0"
I20260811 07:16:41.331203 13274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:41.354939 13274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:41.357112 13274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:41.357224 13274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:41.357683 13274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:41.357755 13274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.357800 13274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:41.357826 13274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432601, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:41.365522 13274 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:42953
I20260811 07:16:41.365612 13500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:42953 every 8 connection(s)
I20260811 07:16:41.365975 13274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:16:41.367820 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.358219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:53205 (local address 127.9.142.190:38945)
0811 07:16:41.358293 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.358297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.358480 (+ 183us) server_negotiation.cc:407] Connection header received
0811 07:16:41.358964 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.358965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.358979 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.359065 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:41.359859 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.360696 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.361696 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.362052 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.362137 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.364872 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:41.364874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:41.364874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:41.364883 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:41.366587 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.366956 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.366957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.366957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.367013 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.367176 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.367176 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.367176 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.367268 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:41.367346 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.367612 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.367687 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 07:16:41.367901 13309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.358151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:38945 (local address 127.9.142.130:53205)
0811 07:16:41.358335 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.358375 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.358860 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.359112 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.359115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.359459 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:41.359756 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.359763 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.360806 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.360807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.361623 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.361626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.362157 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.362159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.362290 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.362809 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:41.362818 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:41.364769 (+ 1951us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:41.366658 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.366662 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.366664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.366886 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.367055 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.367055 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.367055 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.367139 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.367341 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:41.367346 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:41.367463 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.367546 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.367662 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260811 07:16:41.368425 13502 heartbeater.cc:347] Connected to a master server at 127.9.142.190:38945
I20260811 07:16:41.368510 13502 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:41.368696 13502 heartbeater.cc:511] Master 127.9.142.190:38945 requested a full tablet report, sending...
I20260811 07:16:41.369102 12903 ts_manager.cc:194] Registered new tserver with Master: 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953)
I20260811 07:16:41.369501 12903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:53205
I20260811 07:16:41.375173 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 13274
I20260811 07:16:41.375322 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:16:41.375541 9786 external_mini_cluster.cc:1428] Setting key a392c17db6333184d8897e9be5dc4c55
I20260811 07:16:41.376107 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.370235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:38843 (local address 127.9.142.190:38945)
0811 07:16:41.370282 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.370283 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.370381 (+ 98us) server_negotiation.cc:407] Connection header received
0811 07:16:41.370448 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.370449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.370459 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.370515 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:41.370870 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.371403 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.372234 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.372434 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.372518 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.373428 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:41.373429 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:41.373429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:41.373436 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:41.374806 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.375187 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.375188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.375189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.375250 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.375497 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.375498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.375498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.375701 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:41.375798 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.375988 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.376050 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:16:41.376170 13513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.370157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:38945 (local address 127.9.142.130:38843)
0811 07:16:41.370311 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.370321 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.370398 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.370521 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.370521 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.370724 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:41.370806 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.370809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.371510 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.371511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.372136 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.372139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.372521 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.372522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.372607 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.373028 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:41.373033 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:41.373312 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:41.374908 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.374909 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.374910 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.375111 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.375324 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.375325 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.375325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.375390 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.375821 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:41.375822 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:41.375875 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.375961 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.376069 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:16:41.402782 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:38945
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:41.487206 13517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:41.487434 13517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:41.487478 13517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:41.488740 13517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:41.488814 13517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:41.488852 13517 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:16:41.488898 13517 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:16:41.488936 13517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:16:41.490386 13517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.142.190:38945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:41.490643 13517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:41.490880 13517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:41.495996 13527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:41.496124 13517 server_base.cc:1034] running on GCE node
W20260811 07:16:41.496011 13526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:41.496003 13529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:41.496397 13517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:41.496644 13517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:41.497786 13517 hybrid_clock.cc:648] HybridClock initialized: now 1786432601497767 us; error 35 us; skew 500 ppm
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432601, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:41.500310 13517 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:16:41.500871 13517 webserver.cc:460] Webserver started at http://127.9.142.131:45605/ using document root <none> and password file <none>
I20260811 07:16:41.501073 13517 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:41.501116 13517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:41.501204 13517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:41.502166 13517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "44806ef39dc04b598fc25d877e14756c"
format_stamp: "Formatted at 2026-08-11 07:16:41 on dist-test-slave-7f01"
server_key: "726e6dab7431e5ab387c1cb25e9fc295"
server_key_iv: "ef89e6be1667d6416ad3ecdd7eb14d81"
server_key_version: "encryptionkey@0"
I20260811 07:16:41.502473 13517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "44806ef39dc04b598fc25d877e14756c"
format_stamp: "Formatted at 2026-08-11 07:16:41 on dist-test-slave-7f01"
server_key: "726e6dab7431e5ab387c1cb25e9fc295"
server_key_iv: "ef89e6be1667d6416ad3ecdd7eb14d81"
server_key_version: "encryptionkey@0"
I20260811 07:16:41.503885 13517 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:16:41.504725 13537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.504912 13517 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:41.505044 13517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "44806ef39dc04b598fc25d877e14756c"
format_stamp: "Formatted at 2026-08-11 07:16:41 on dist-test-slave-7f01"
server_key: "726e6dab7431e5ab387c1cb25e9fc295"
server_key_iv: "ef89e6be1667d6416ad3ecdd7eb14d81"
server_key_version: "encryptionkey@0"
I20260811 07:16:41.505117 13517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:41.515441 13517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:41.517789 13517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:41.517904 13517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:41.518438 13517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:41.518501 13517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.518530 13517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:41.518622 13517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.525182 13517 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:43649
I20260811 07:16:41.525305 13743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:43649 every 8 connection(s)
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432601, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:41.525609 13517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:16:41.527915 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 13517
I20260811 07:16:41.528016 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:16:41.528205 9786 external_mini_cluster.cc:1428] Setting key 584447815e1bcf811256369874b5e8bf
I20260811 07:16:41.529054 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.518864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:38841 (local address 127.9.142.190:38945)
0811 07:16:41.518905 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.518907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.519146 (+ 239us) server_negotiation.cc:407] Connection header received
0811 07:16:41.519644 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.519646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.519659 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.519710 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:41.520545 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.521369 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.522926 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.523274 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.523357 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.526067 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:41.526069 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:41.526069 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:41.526076 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:41.527399 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.527888 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.527889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.527890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.527969 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.528294 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.528295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.528295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.528453 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:41.528526 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.528878 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.528963 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 07:16:41.529215 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.518874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:38945 (local address 127.9.142.131:38841)
0811 07:16:41.519032 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.519064 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.519531 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.519838 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.519842 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.520150 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:41.520426 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.520434 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.521474 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.521475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.522827 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.522830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.523384 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.523385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.523527 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.524111 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:41.524122 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:41.525979 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:41.527473 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.527480 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.527482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.527703 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.528079 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.528080 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.528081 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.528201 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.528547 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:41.528556 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:41.528719 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.528820 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.528990 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":98,"threads_started":1}
I20260811 07:16:41.529778 13745 heartbeater.cc:347] Connected to a master server at 127.9.142.190:38945
I20260811 07:16:41.529881 13745 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:41.530067 13745 heartbeater.cc:511] Master 127.9.142.190:38945 requested a full tablet report, sending...
I20260811 07:16:41.530478 12903 ts_manager.cc:194] Registered new tserver with Master: 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649)
I20260811 07:16:41.531003 12903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:38841
I20260811 07:16:41.536127 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.530897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:45227 (local address 127.9.142.190:38945)
0811 07:16:41.530943 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.530945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.531005 (+ 60us) server_negotiation.cc:407] Connection header received
0811 07:16:41.531077 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.531077 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.531088 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.531139 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:41.531595 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.532126 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.532765 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.532939 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.532987 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.533761 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:41.533763 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:41.533763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:41.533769 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:41.535207 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.535503 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.535504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.535504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.535555 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.535714 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.535715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.535715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.535852 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:41.535904 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.536014 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.536072 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:16:41.536142 13757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.530823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:38945 (local address 127.9.142.131:45227)
0811 07:16:41.530949 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.530960 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.531021 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.531218 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.531219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.531437 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:41.531510 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.531512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.532223 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.532224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.532695 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.532697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.533002 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.533003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.533052 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.533423 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:41.533427 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:41.533686 (+ 259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:41.535274 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.535275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.535275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.535433 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.535609 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.535610 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.535610 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.535664 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.535906 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:41.535907 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:41.535944 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.536000 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.536076 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
I20260811 07:16:41.540051 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:41.563855 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.557140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49144 (local address 127.9.142.190:38945)
0811 07:16:41.557199 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.557202 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.557210 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:16:41.557260 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.557261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.557277 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.557341 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:41.557896 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.558369 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.559100 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.559286 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.559367 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.561532 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:41.561534 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:41.561534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:41.561541 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:41.562696 (+ 1155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.563049 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.563050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.563051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.563107 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.563307 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.563308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.563308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.563416 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:41.563522 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.563641 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.563717 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 07:16:41.565331 12903 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:16:41.566936 12903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:41.573820 13773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.569409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:34351 (local address 127.0.0.1:50496)
0811 07:16:41.569798 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.569807 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.569845 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.570123 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.570126 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.570129 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:41.570189 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.570190 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.571540 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.571541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.572652 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.572655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.573508 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.573509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.573600 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.573620 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.573688 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.573741 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":1,"thread_start_us":62,"threads_started":1}
I20260811 07:16:41.573959 13776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.569446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:43649 (local address 127.0.0.1:33210)
0811 07:16:41.569931 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.569940 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.569980 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.570403 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.570404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.570406 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:41.570468 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.570470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.571637 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.571638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.572923 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.572925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.573649 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.573651 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.573716 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.573721 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.573778 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.573820 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":11,"thread_start_us":87,"threads_started":1}
I20260811 07:16:41.574122 13777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.569659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50496 (local address 127.9.142.129:34351)
0811 07:16:41.569841 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.569870 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.569883 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:16:41.569929 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.569931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.569948 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.570103 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:41.570278 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.571443 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.572734 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.573411 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.573487 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.573543 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.573946 (+ 403us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.574006 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":111,"threads_started":1}
I20260811 07:16:41.574231 13774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.569408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42953 (local address 127.0.0.1:43868)
0811 07:16:41.569587 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.569626 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.569698 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.570327 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.570328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.570330 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:41.570383 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.570384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.571767 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.571768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.572904 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.572907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.573787 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.573788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.573853 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.573858 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.573914 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.573956 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":4,"thread_start_us":91,"threads_started":1}
I20260811 07:16:41.574635 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.569910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43868 (local address 127.9.142.130:42953)
0811 07:16:41.570113 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.570117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.570128 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:16:41.570170 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.570172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.570189 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.570297 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:41.570476 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.571642 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.573005 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.573724 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.573788 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.573837 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.574499 (+ 662us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.574541 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":105,"threads_started":1}
I20260811 07:16:41.574244 13779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.569696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33210 (local address 127.9.142.131:43649)
0811 07:16:41.570217 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.570224 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.570234 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:16:41.570281 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.570284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.570298 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.570398 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:41.570536 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.571557 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.573040 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.573565 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.573633 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.573691 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.574087 (+ 396us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.574132 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":86,"threads_started":1}
I20260811 07:16:41.574899 13148 tablet_service.cc:1467] Processing CreateTablet for tablet c0213ff53a664f828acefedddd5c04b7 (DEFAULT_TABLE table=test-table [id=7cab2d70ac684e1088361468878fdb61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:41.575325 13148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0213ff53a664f828acefedddd5c04b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:41.575292 13389 tablet_service.cc:1467] Processing CreateTablet for tablet c0213ff53a664f828acefedddd5c04b7 (DEFAULT_TABLE table=test-table [id=7cab2d70ac684e1088361468878fdb61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:41.575634 13389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0213ff53a664f828acefedddd5c04b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:41.575531 13631 tablet_service.cc:1467] Processing CreateTablet for tablet c0213ff53a664f828acefedddd5c04b7 (DEFAULT_TABLE table=test-table [id=7cab2d70ac684e1088361468878fdb61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:41.575882 13631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0213ff53a664f828acefedddd5c04b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:41.578491 13782 tablet_bootstrap.cc:492] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: Bootstrap starting.
I20260811 07:16:41.579034 13785 tablet_bootstrap.cc:492] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: Bootstrap starting.
I20260811 07:16:41.579133 13782 tablet_bootstrap.cc:654] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:41.579303 13786 tablet_bootstrap.cc:492] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Bootstrap starting.
I20260811 07:16:41.579936 13782 log.cc:824] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:41.580054 13786 tablet_bootstrap.cc:654] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:41.580071 13785 tablet_bootstrap.cc:654] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:41.580389 13785 log.cc:824] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:41.580470 13786 log.cc:824] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:41.580808 13782 tablet_bootstrap.cc:492] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: No bootstrap required, opened a new log
I20260811 07:16:41.580892 13782 ts_tablet_manager.cc:1397] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 07:16:41.581239 13785 tablet_bootstrap.cc:492] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: No bootstrap required, opened a new log
I20260811 07:16:41.581313 13785 ts_tablet_manager.cc:1397] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:16:41.583016 13782 raft_consensus.cc:348] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.583199 13782 raft_consensus.cc:374] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.583235 13782 raft_consensus.cc:729] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d6ced1cfcb4ce3b454b547e23f4a71, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.583360 13782 consensus_queue.cc:260] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.583374 13785 raft_consensus.cc:348] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.583526 13785 raft_consensus.cc:374] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.583578 13785 raft_consensus.cc:729] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44806ef39dc04b598fc25d877e14756c, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.583693 13782 ts_tablet_manager.cc:1428] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:16:41.583693 13785 consensus_queue.cc:260] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.583761 13262 heartbeater.cc:503] Master 127.9.142.190:38945 was elected leader, sending a full tablet report...
I20260811 07:16:41.584010 13785 ts_tablet_manager.cc:1428] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 07:16:41.584087 13745 heartbeater.cc:503] Master 127.9.142.190:38945 was elected leader, sending a full tablet report...
I20260811 07:16:41.584525 13786 tablet_bootstrap.cc:492] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: No bootstrap required, opened a new log
I20260811 07:16:41.584594 13786 ts_tablet_manager.cc:1397] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260811 07:16:41.586163 13786 raft_consensus.cc:348] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.586267 13786 raft_consensus.cc:374] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.586287 13786 raft_consensus.cc:729] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114cd5f29a2c47b2a4e3cf7fb8e9da34, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.586362 13786 consensus_queue.cc:260] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.586558 13786 ts_tablet_manager.cc:1428] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:16:41.586640 13502 heartbeater.cc:503] Master 127.9.142.190:38945 was elected leader, sending a full tablet report...
W20260811 07:16:41.616618 13503 tablet.cc:2369] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:16:41.698254 13263 tablet.cc:2369] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:16:41.776337 13747 tablet.cc:2369] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:16:41.780120 13794 raft_consensus.cc:482] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:41.780226 13794 raft_consensus.cc:504] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.780588 13794 leader_election.cc:288] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351), 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953)
I20260811 07:16:41.783667 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.780911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:58423 (local address 127.9.142.130:42953)
0811 07:16:41.780999 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.781001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.781010 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:16:41.781041 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.781042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.781051 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.781125 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:41.781315 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.781899 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.782884 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.783287 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.783345 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.783376 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.783547 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.783591 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:16:41.783694 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.780799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42953 (local address 127.9.142.131:58423)
0811 07:16:41.780864 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.780878 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.780936 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.781130 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.781131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.781132 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:41.781227 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.781230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.781987 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.781988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.782784 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.782787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.783376 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.783377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.783469 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.783472 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.783515 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.783576 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 07:16:41.783694 13777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.780908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:52693 (local address 127.9.142.129:34351)
0811 07:16:41.780991 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.780993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.781264 (+ 271us) server_negotiation.cc:407] Connection header received
0811 07:16:41.781296 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.781297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.781307 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.781348 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:41.781517 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.782025 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.782943 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.783298 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.783389 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.783396 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.783578 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.783626 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:16:41.783720 13797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.780809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:34351 (local address 127.9.142.131:52693)
0811 07:16:41.781156 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.781166 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.781231 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.781364 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.781365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.781366 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:41.781450 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.781451 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.782107 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.782107 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.782816 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.782818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.783405 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.783406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.783478 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.783481 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.783554 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.783592 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":143,"thread_start_us":152,"threads_started":1}
I20260811 07:16:41.784155 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0213ff53a664f828acefedddd5c04b7" candidate_uuid: "44806ef39dc04b598fc25d877e14756c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" is_pre_election: true
I20260811 07:16:41.784325 13421 raft_consensus.cc:2454] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44806ef39dc04b598fc25d877e14756c in term 0.
I20260811 07:16:41.784272 13182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0213ff53a664f828acefedddd5c04b7" candidate_uuid: "44806ef39dc04b598fc25d877e14756c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" is_pre_election: true
I20260811 07:16:41.784446 13182 raft_consensus.cc:2454] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44806ef39dc04b598fc25d877e14756c in term 0.
I20260811 07:16:41.784628 13541 leader_election.cc:302] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114cd5f29a2c47b2a4e3cf7fb8e9da34, 44806ef39dc04b598fc25d877e14756c; no voters:
I20260811 07:16:41.784803 13794 raft_consensus.cc:2781] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:41.784865 13794 raft_consensus.cc:482] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:41.784893 13794 raft_consensus.cc:3037] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:41.785843 13794 raft_consensus.cc:504] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.786012 13794 leader_election.cc:288] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [CANDIDATE]: Term 1 election: Requested vote from peers 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351), 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953)
I20260811 07:16:41.786140 13182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0213ff53a664f828acefedddd5c04b7" candidate_uuid: "44806ef39dc04b598fc25d877e14756c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71"
I20260811 07:16:41.786190 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0213ff53a664f828acefedddd5c04b7" candidate_uuid: "44806ef39dc04b598fc25d877e14756c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34"
I20260811 07:16:41.786237 13182 raft_consensus.cc:3037] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:41.786289 13421 raft_consensus.cc:3037] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:41.786993 13182 raft_consensus.cc:2454] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44806ef39dc04b598fc25d877e14756c in term 1.
I20260811 07:16:41.787094 13421 raft_consensus.cc:2454] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44806ef39dc04b598fc25d877e14756c in term 1.
I20260811 07:16:41.787179 13538 leader_election.cc:302] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03d6ced1cfcb4ce3b454b547e23f4a71, 44806ef39dc04b598fc25d877e14756c; no voters:
I20260811 07:16:41.787272 13794 raft_consensus.cc:2781] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:41.787437 13794 raft_consensus.cc:686] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 1 LEADER]: Becoming Leader. State: Replica: 44806ef39dc04b598fc25d877e14756c, State: Running, Role: LEADER
I20260811 07:16:41.787562 13794 consensus_queue.cc:237] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.788436 12904 catalog_manager.cc:5495] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c reported cstate change: term changed from 0 to 1, leader changed from <none> to 44806ef39dc04b598fc25d877e14756c (127.9.142.131). New cstate: current_term: 1 leader_uuid: "44806ef39dc04b598fc25d877e14756c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } health_report { overall_health: HEALTHY } } }
Aug 11 07:16:41 dist-test-slave-7f01 krb5kdc[12823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432600, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:41.831310 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.824411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:38945 (local address 127.0.0.1:49154)
0811 07:16:41.824582 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.824592 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.824657 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.824784 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.824785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.825093 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:41.825142 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.825145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.825808 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.825809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.826337 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.826338 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.826649 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.826650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.826694 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.827189 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:41.827193 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:41.828601 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:41.830216 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.830223 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.830225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.830427 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.830634 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:41.830635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:41.830635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:41.830694 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:41.831007 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:41.831014 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:41.831059 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.831118 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.831212 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260811 07:16:41.831394 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.824489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49154 (local address 127.9.142.190:38945)
0811 07:16:41.824602 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.824604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.824658 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:16:41.824713 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.824714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.824723 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.824765 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:41.825233 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.825733 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.826408 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.826586 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.826637 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.828677 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:41.828679 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:41.828679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:41.828685 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:41.830143 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.830504 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.830505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.830505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.830573 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:41.830780 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:41.830780 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:41.830781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:41.830881 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:41.830956 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.831152 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.831261 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":79}
I20260811 07:16:41.833315 12904 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:49154:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:16:41.833586 12904 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:41.835119 13148 tablet_service.cc:1467] Processing CreateTablet for tablet 3ca5e2f6c1264ccb843d103f47585c65 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=46e9ee8b8218440b8ba917afba5fe7d1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:16:41.835134 13631 tablet_service.cc:1467] Processing CreateTablet for tablet 3ca5e2f6c1264ccb843d103f47585c65 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=46e9ee8b8218440b8ba917afba5fe7d1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:16:41.835125 13389 tablet_service.cc:1467] Processing CreateTablet for tablet 3ca5e2f6c1264ccb843d103f47585c65 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=46e9ee8b8218440b8ba917afba5fe7d1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:16:41.835320 13389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ca5e2f6c1264ccb843d103f47585c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:41.835323 13148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ca5e2f6c1264ccb843d103f47585c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:41.835320 13631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ca5e2f6c1264ccb843d103f47585c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:41.836771 13782 tablet_bootstrap.cc:492] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: Bootstrap starting.
I20260811 07:16:41.836889 13786 tablet_bootstrap.cc:492] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Bootstrap starting.
I20260811 07:16:41.837245 13782 tablet_bootstrap.cc:654] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:41.837608 13786 tablet_bootstrap.cc:654] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:41.837862 13782 tablet_bootstrap.cc:492] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: No bootstrap required, opened a new log
I20260811 07:16:41.837909 13782 ts_tablet_manager.cc:1397] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:41.837994 13785 tablet_bootstrap.cc:492] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: Bootstrap starting.
I20260811 07:16:41.838101 13782 raft_consensus.cc:348] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.838200 13782 raft_consensus.cc:374] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.838234 13782 raft_consensus.cc:729] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d6ced1cfcb4ce3b454b547e23f4a71, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.838276 13782 consensus_queue.cc:260] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.838362 13786 tablet_bootstrap.cc:492] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: No bootstrap required, opened a new log
I20260811 07:16:41.838376 13782 ts_tablet_manager.cc:1428] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 07:16:41.838409 13786 ts_tablet_manager.cc:1397] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:16:41.838488 13785 tablet_bootstrap.cc:654] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:41.838466 13793 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.838542 13793 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:41.838587 13786 raft_consensus.cc:348] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.838680 13786 raft_consensus.cc:374] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.838707 13786 raft_consensus.cc:729] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114cd5f29a2c47b2a4e3cf7fb8e9da34, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.838757 13786 consensus_queue.cc:260] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.838873 13786 ts_tablet_manager.cc:1428] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.838971 13796 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.839087 13796 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:41.839608 13785 tablet_bootstrap.cc:492] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: No bootstrap required, opened a new log
I20260811 07:16:41.839663 13785 ts_tablet_manager.cc:1397] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260811 07:16:41.839833 13785 raft_consensus.cc:348] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.839908 13785 raft_consensus.cc:374] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.839922 13785 raft_consensus.cc:729] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44806ef39dc04b598fc25d877e14756c, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.839993 13785 consensus_queue.cc:260] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.840088 13785 ts_tablet_manager.cc:1428] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.840148 13794 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.840245 13794 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:41.928136 13796 raft_consensus.cc:482] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:41.928263 13796 raft_consensus.cc:504] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.928696 13796 leader_election.cc:288] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351), 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649)
I20260811 07:16:41.932977 13777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.929011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:43403 (local address 127.9.142.129:34351)
0811 07:16:41.929068 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.929071 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.929189 (+ 118us) server_negotiation.cc:407] Connection header received
0811 07:16:41.929275 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.929276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.929287 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.929356 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:41.929586 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.930380 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.932053 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.932603 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.932684 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.932693 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.932866 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.932907 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:16:41.932978 13779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.929059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:33199 (local address 127.9.142.131:43649)
0811 07:16:41.929155 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.929157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.929239 (+ 82us) server_negotiation.cc:407] Connection header received
0811 07:16:41.929292 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.929294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.929309 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.929365 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:41.929586 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.930373 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.932053 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.932603 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.932683 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.932693 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.932864 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.932907 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:16:41.933018 13818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.928876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:34351 (local address 127.9.142.130:43403)
0811 07:16:41.929120 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.929131 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.929209 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.929385 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.929386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.929389 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:41.929490 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.929493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.930495 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.930497 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.931955 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.931959 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.932694 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.932696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.932776 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.932785 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.932844 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.932896 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":84,"thread_start_us":108,"threads_started":1}
I20260811 07:16:41.933038 13819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.928881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:43649 (local address 127.9.142.130:33199)
0811 07:16:41.929166 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.929175 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.929233 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.929386 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.929386 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.929389 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:41.929511 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.929512 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.930496 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.930497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.931954 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.931959 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.932696 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.932697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.932776 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.932783 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.932851 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.932896 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":132,"thread_start_us":109,"threads_started":1}
I20260811 07:16:41.933373 13182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca5e2f6c1264ccb843d103f47585c65" candidate_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" is_pre_election: true
I20260811 07:16:41.933465 13182 raft_consensus.cc:2454] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 114cd5f29a2c47b2a4e3cf7fb8e9da34 in term 0.
I20260811 07:16:41.933719 13295 leader_election.cc:302] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03d6ced1cfcb4ce3b454b547e23f4a71, 114cd5f29a2c47b2a4e3cf7fb8e9da34; no voters:
I20260811 07:16:41.933728 13662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca5e2f6c1264ccb843d103f47585c65" candidate_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44806ef39dc04b598fc25d877e14756c" is_pre_election: true
I20260811 07:16:41.933849 13662 raft_consensus.cc:2454] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 114cd5f29a2c47b2a4e3cf7fb8e9da34 in term 0.
I20260811 07:16:41.933905 13796 raft_consensus.cc:2781] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:41.933962 13796 raft_consensus.cc:482] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:41.933984 13796 raft_consensus.cc:3037] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:41.934756 13796 raft_consensus.cc:504] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.934907 13796 leader_election.cc:288] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [CANDIDATE]: Term 1 election: Requested vote from peers 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351), 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649)
I20260811 07:16:41.935091 13662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca5e2f6c1264ccb843d103f47585c65" candidate_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44806ef39dc04b598fc25d877e14756c"
I20260811 07:16:41.935158 13182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca5e2f6c1264ccb843d103f47585c65" candidate_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71"
I20260811 07:16:41.935214 13662 raft_consensus.cc:3037] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:41.935223 13182 raft_consensus.cc:3037] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:41.936111 13182 raft_consensus.cc:2454] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114cd5f29a2c47b2a4e3cf7fb8e9da34 in term 1.
I20260811 07:16:41.936154 13662 raft_consensus.cc:2454] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 114cd5f29a2c47b2a4e3cf7fb8e9da34 in term 1.
I20260811 07:16:41.936317 13297 leader_election.cc:302] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114cd5f29a2c47b2a4e3cf7fb8e9da34, 44806ef39dc04b598fc25d877e14756c; no voters:
I20260811 07:16:41.936463 13796 raft_consensus.cc:2781] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:41.936621 13796 raft_consensus.cc:686] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 LEADER]: Becoming Leader. State: Replica: 114cd5f29a2c47b2a4e3cf7fb8e9da34, State: Running, Role: LEADER
I20260811 07:16:41.936733 13796 consensus_queue.cc:237] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.937213 13822 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: TxnStatusTablet state changed. Reason: New leader 114cd5f29a2c47b2a4e3cf7fb8e9da34. Latest consensus state: current_term: 1 leader_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.937320 13822 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:16:41.937532 13824 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:16:41.937692 13824 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:16:41.937629 12904 catalog_manager.cc:5495] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130). New cstate: current_term: 1 leader_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } health_report { overall_health: UNKNOWN } } }
I20260811 07:16:41.955838 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.953049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43884 (local address 127.9.142.130:42953)
0811 07:16:41.953089 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.953093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.953106 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:16:41.953196 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.953196 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.953212 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.953276 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:41.953427 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.953890 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.954981 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.955154 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.955198 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.955444 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:41.955549 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:41.955644 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.955698 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.955724 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:16:41.955858 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.952978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42953 (local address 127.0.0.1:43884)
0811 07:16:41.953064 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.953074 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.953119 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.953306 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.953307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.953308 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:16:41.953360 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.953363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.953965 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.953966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.954891 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.954894 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.955222 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.955223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.955300 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.955317 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:16:41.955632 (+ 315us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:16:41.955642 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.955694 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.955767 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 07:16:41.957645 13662 raft_consensus.cc:1261] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Refusing update from remote peer 114cd5f29a2c47b2a4e3cf7fb8e9da34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:41.957722 13182 raft_consensus.cc:1261] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Refusing update from remote peer 114cd5f29a2c47b2a4e3cf7fb8e9da34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:41.957952 13822 consensus_queue.cc:1035] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:41.958073 13796 consensus_queue.cc:1035] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:41.959195 13793 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: TxnStatusTablet state changed. Reason: New leader 114cd5f29a2c47b2a4e3cf7fb8e9da34. Latest consensus state: current_term: 1 leader_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.959297 13793 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:41.959767 13794 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: TxnStatusTablet state changed. Reason: New leader 114cd5f29a2c47b2a4e3cf7fb8e9da34. Latest consensus state: current_term: 1 leader_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.959877 13794 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:41.960388 13822 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.960469 13822 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:16:41.960847 13796 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.960933 13796 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:16:41.961058 13794 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.961138 13794 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 44806ef39dc04b598fc25d877e14756c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:41.961290 13793 tablet_replica.cc:439] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } } }
I20260811 07:16:41.961374 13793 tablet_replica.cc:442] T 3ca5e2f6c1264ccb843d103f47585c65 P 03d6ced1cfcb4ce3b454b547e23f4a71: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:16:41.961484 13829 mvcc.cc:205] Tried to move back new op lower bound from 7317227937616039936 to 7317227937533566976. Current Snapshot: MvccSnapshot[applied={T|T < 7317227937616039936}]
I20260811 07:16:41.962069 13830 mvcc.cc:205] Tried to move back new op lower bound from 7317227937616039936 to 7317227937533566976. Current Snapshot: MvccSnapshot[applied={T|T < 7317227937616039936}]
I20260811 07:16:41.965854 13779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.963339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33214 (local address 127.9.142.131:43649)
0811 07:16:41.963377 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.963380 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.963419 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:16:41.963495 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.963496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.963513 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.963572 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:41.963724 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.964207 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.964997 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.965245 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.965340 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.965530 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:41.965631 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:41.965713 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.965765 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.965785 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:16:41.970695 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.968255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:46777 (local address 127.9.142.130:42953)
0811 07:16:41.968299 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.968301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.968310 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:16:41.968380 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.968381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.968390 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.968447 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:41.968611 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.969081 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.969928 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.970132 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.970229 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.970434 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:41.970469 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:41.970537 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.970609 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.970629 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:16:41.970705 13757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.968190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42953 (local address 127.9.142.131:46777)
0811 07:16:41.968262 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.968273 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.968329 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.968478 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.968479 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.968480 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:16:41.968535 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.968540 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.969169 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.969170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.969847 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.969849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.970233 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.970234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.970299 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.970322 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:16:41.970540 (+ 218us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:16:41.970542 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.970606 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.970644 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 07:16:41.973184 13421 raft_consensus.cc:1261] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Refusing update from remote peer 44806ef39dc04b598fc25d877e14756c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:41.973399 13182 raft_consensus.cc:1261] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Refusing update from remote peer 44806ef39dc04b598fc25d877e14756c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:41.973529 13798 consensus_queue.cc:1035] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [LEADER]: Connected to new peer: Peer: permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:41.973803 13798 consensus_queue.cc:1035] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [LEADER]: Connected to new peer: Peer: permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:41.981817 13779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.979458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:38577 (local address 127.9.142.131:43649)
0811 07:16:41.979501 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:41.979503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:41.979574 (+ 71us) server_negotiation.cc:407] Connection header received
0811 07:16:41.979646 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:41.979647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:41.979658 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:41.979711 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:41.979883 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.980338 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.981122 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.981391 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.981460 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.981651 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:41.981675 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:41.981708 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:41.981760 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 07:16:41.981775 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:16:41.981894 13858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:41.979285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:43649 (local address 127.9.142.130:38577)
0811 07:16:41.979518 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:41.979528 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:41.979597 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:41.979714 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:41.979715 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:41.979717 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:16:41.979825 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.979827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.980425 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.980426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.981050 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:41.981052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:41.981481 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:41.981482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:41.981554 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:41.981571 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:16:41.981710 (+ 139us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:16:41.981711 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 07:16:41.981759 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 07:16:41.981806 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":87,"threads_started":1}
I20260811 07:16:41.988431 12903 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:41.988531 12903 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:41.989295 12903 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: Sending DeleteTablet for 3 replicas of tablet c0213ff53a664f828acefedddd5c04b7
I20260811 07:16:41.989656 13631 tablet_service.cc:1514] Processing DeleteTablet for tablet c0213ff53a664f828acefedddd5c04b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:41 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:33210
I20260811 07:16:41.989892 13148 tablet_service.cc:1514] Processing DeleteTablet for tablet c0213ff53a664f828acefedddd5c04b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:41 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:50496
I20260811 07:16:41.990051 13389 tablet_service.cc:1514] Processing DeleteTablet for tablet c0213ff53a664f828acefedddd5c04b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:41 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:43868
I20260811 07:16:41.990222 12903 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 07:16:41.990362 13867 tablet_replica.cc:330] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: stopping tablet replica
W20260811 07:16:41.990360 12903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:41.990458 13867 raft_consensus.cc:2229] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:41.990506 13867 raft_consensus.cc:2258] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:41.990909 13867 ts_tablet_manager.cc:1905] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:41.991384 13865 tablet_replica.cc:330] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: stopping tablet replica
I20260811 07:16:41.991513 13865 raft_consensus.cc:2229] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:16:41.991632 13865 raft_consensus.cc:2258] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:41.991793 13148 tablet_service.cc:1467] Processing CreateTablet for tablet 5b60b058cac4482ca8c8a7d0aed5b0e6 (DEFAULT_TABLE table=test-table [id=0661bf77d65149b9ac2dbd880b6bb13f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:41.992096 13631 tablet_service.cc:1467] Processing CreateTablet for tablet 5b60b058cac4482ca8c8a7d0aed5b0e6 (DEFAULT_TABLE table=test-table [id=0661bf77d65149b9ac2dbd880b6bb13f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:41.992121 13865 ts_tablet_manager.cc:1905] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:41.992007 13389 tablet_service.cc:1467] Processing CreateTablet for tablet 5b60b058cac4482ca8c8a7d0aed5b0e6 (DEFAULT_TABLE table=test-table [id=0661bf77d65149b9ac2dbd880b6bb13f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:41.992578 13389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b60b058cac4482ca8c8a7d0aed5b0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:41.992723 13148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b60b058cac4482ca8c8a7d0aed5b0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:41.992914 13867 ts_tablet_manager.cc:1918] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:16:41.992980 13867 log.cc:1196] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/c0213ff53a664f828acefedddd5c04b7
I20260811 07:16:41.993263 13867 ts_tablet_manager.cc:1939] T c0213ff53a664f828acefedddd5c04b7 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting consensus metadata
I20260811 07:16:41.993898 13786 tablet_bootstrap.cc:492] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Bootstrap starting.
I20260811 07:16:41.993984 12884 catalog_manager.cc:4841] TS 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953): tablet c0213ff53a664f828acefedddd5c04b7 (table test-table [id=7cab2d70ac684e1088361468878fdb61]) successfully deleted
I20260811 07:16:41.994330 13786 tablet_bootstrap.cc:654] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:41.994446 13631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b60b058cac4482ca8c8a7d0aed5b0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:41.995662 13782 tablet_bootstrap.cc:492] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: Bootstrap starting.
I20260811 07:16:41.995795 13785 tablet_bootstrap.cc:492] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: Bootstrap starting.
I20260811 07:16:41.996119 13782 tablet_bootstrap.cc:654] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:41.996213 13785 tablet_bootstrap.cc:654] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:41.996345 13786 tablet_bootstrap.cc:492] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: No bootstrap required, opened a new log
I20260811 07:16:41.996392 13786 ts_tablet_manager.cc:1397] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 07:16:41.996556 13865 ts_tablet_manager.cc:1918] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:16:41.996554 13786 raft_consensus.cc:348] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.996614 13865 log.cc:1196] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/c0213ff53a664f828acefedddd5c04b7
I20260811 07:16:41.996618 13786 raft_consensus.cc:374] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.996639 13786 raft_consensus.cc:729] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114cd5f29a2c47b2a4e3cf7fb8e9da34, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.996683 13786 consensus_queue.cc:260] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.996763 13786 ts_tablet_manager.cc:1428] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 07:16:41.996855 13865 ts_tablet_manager.cc:1939] T c0213ff53a664f828acefedddd5c04b7 P 44806ef39dc04b598fc25d877e14756c: Deleting consensus metadata
I20260811 07:16:41.997536 12887 catalog_manager.cc:4841] TS 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649): tablet c0213ff53a664f828acefedddd5c04b7 (table test-table [id=7cab2d70ac684e1088361468878fdb61]) successfully deleted
I20260811 07:16:41.997978 13782 tablet_bootstrap.cc:492] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: No bootstrap required, opened a new log
I20260811 07:16:41.998039 13782 ts_tablet_manager.cc:1397] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:16:41.998132 13785 tablet_bootstrap.cc:492] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: No bootstrap required, opened a new log
I20260811 07:16:41.998174 13785 ts_tablet_manager.cc:1397] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260811 07:16:41.998173 13782 raft_consensus.cc:348] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.998260 13782 raft_consensus.cc:374] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.998281 13782 raft_consensus.cc:729] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d6ced1cfcb4ce3b454b547e23f4a71, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.998322 13782 consensus_queue.cc:260] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.998354 13785 raft_consensus.cc:348] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.998432 13785 raft_consensus.cc:374] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:41.998430 13782 ts_tablet_manager.cc:1428] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.998454 13785 raft_consensus.cc:729] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44806ef39dc04b598fc25d877e14756c, State: Initialized, Role: FOLLOWER
I20260811 07:16:41.998513 13785 consensus_queue.cc:260] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:41.998605 13785 ts_tablet_manager.cc:1428] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:41.999888 13866 tablet_replica.cc:330] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: stopping tablet replica
I20260811 07:16:42.000011 13866 raft_consensus.cc:2229] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:42.000079 13866 raft_consensus.cc:2258] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:42.000512 13866 ts_tablet_manager.cc:1905] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:42.002081 13866 ts_tablet_manager.cc:1918] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:16:42.002166 13866 log.cc:1196] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/c0213ff53a664f828acefedddd5c04b7
I20260811 07:16:42.002429 13866 ts_tablet_manager.cc:1939] T c0213ff53a664f828acefedddd5c04b7 P 03d6ced1cfcb4ce3b454b547e23f4a71: Deleting consensus metadata
I20260811 07:16:42.002867 12882 catalog_manager.cc:4841] TS 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351): tablet c0213ff53a664f828acefedddd5c04b7 (table test-table [id=7cab2d70ac684e1088361468878fdb61]) successfully deleted
I20260811 07:16:42.199184 13793 raft_consensus.cc:482] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:42.199285 13793 raft_consensus.cc:504] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:42.199656 13793 leader_election.cc:288] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953), 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649)
I20260811 07:16:42.202836 13779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:42.200036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:54149 (local address 127.9.142.131:43649)
0811 07:16:42.200093 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:42.200095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:42.200133 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:16:42.200229 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:42.200230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:42.200240 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:42.200302 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:42.200521 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.200986 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.202088 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.202439 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.202518 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:42.202529 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:42.202722 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 07:16:42.202759 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 07:16:42.202845 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:42.200027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:39617 (local address 127.9.142.130:42953)
0811 07:16:42.200080 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:42.200082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:42.200137 (+ 55us) server_negotiation.cc:407] Connection header received
0811 07:16:42.200217 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:42.200218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:42.200230 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:42.200311 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:42.200477 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.200980 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.202082 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.202444 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.202533 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:42.202541 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:42.202739 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 07:16:42.202772 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 07:16:42.202853 13873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:42.199906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:43649 (local address 127.9.142.129:54149)
0811 07:16:42.200072 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:42.200083 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:42.200150 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:42.200330 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:42.200331 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:42.200333 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:42.200393 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:42.200395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.201140 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.201141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:42.201985 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:42.201987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.202528 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.202530 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:42.202599 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:42.202603 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:16:42.202708 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:16:42.202754 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
I20260811 07:16:42.202865 13874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:42.199855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42953 (local address 127.9.142.129:39617)
0811 07:16:42.200069 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:42.200083 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:42.200151 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:42.200315 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:42.200316 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:42.200318 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:42.200377 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:42.200379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.201066 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.201067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:42.201984 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:42.201986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.202550 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.202551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:42.202672 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:42.202676 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:16:42.202732 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:16:42.202770 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":89,"thread_start_us":65,"threads_started":1}
I20260811 07:16:42.203141 13662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60b058cac4482ca8c8a7d0aed5b0e6" candidate_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44806ef39dc04b598fc25d877e14756c" is_pre_election: true
I20260811 07:16:42.203267 13662 raft_consensus.cc:2454] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03d6ced1cfcb4ce3b454b547e23f4a71 in term 0.
I20260811 07:16:42.203429 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60b058cac4482ca8c8a7d0aed5b0e6" candidate_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" is_pre_election: true
I20260811 07:16:42.203467 13061 leader_election.cc:302] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03d6ced1cfcb4ce3b454b547e23f4a71, 44806ef39dc04b598fc25d877e14756c; no voters:
I20260811 07:16:42.203534 13421 raft_consensus.cc:2454] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03d6ced1cfcb4ce3b454b547e23f4a71 in term 0.
I20260811 07:16:42.203598 13793 raft_consensus.cc:2781] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:42.203644 13793 raft_consensus.cc:482] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:42.203665 13793 raft_consensus.cc:3037] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:42.204442 13793 raft_consensus.cc:504] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:42.204594 13793 leader_election.cc:288] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [CANDIDATE]: Term 1 election: Requested vote from peers 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953), 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649)
I20260811 07:16:42.204704 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60b058cac4482ca8c8a7d0aed5b0e6" candidate_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34"
I20260811 07:16:42.204787 13421 raft_consensus.cc:3037] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:42.204806 13662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60b058cac4482ca8c8a7d0aed5b0e6" candidate_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44806ef39dc04b598fc25d877e14756c"
I20260811 07:16:42.204887 13662 raft_consensus.cc:3037] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:42.205693 13421 raft_consensus.cc:2454] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d6ced1cfcb4ce3b454b547e23f4a71 in term 1.
I20260811 07:16:42.205693 13662 raft_consensus.cc:2454] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d6ced1cfcb4ce3b454b547e23f4a71 in term 1.
I20260811 07:16:42.206147 13060 leader_election.cc:302] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03d6ced1cfcb4ce3b454b547e23f4a71, 114cd5f29a2c47b2a4e3cf7fb8e9da34; no voters:
I20260811 07:16:42.206262 13793 raft_consensus.cc:2781] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:42.206410 13793 raft_consensus.cc:686] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 LEADER]: Becoming Leader. State: Replica: 03d6ced1cfcb4ce3b454b547e23f4a71, State: Running, Role: LEADER
I20260811 07:16:42.206471 13793 consensus_queue.cc:237] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:42.207247 12903 catalog_manager.cc:5495] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129). New cstate: current_term: 1 leader_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } health_report { overall_health: UNKNOWN } } }
I20260811 07:16:42.225594 13777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:42.223397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50502 (local address 127.9.142.129:34351)
0811 07:16:42.223447 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:42.223449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:42.223473 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:16:42.223550 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:42.223551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:42.223568 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:42.223623 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:42.223707 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.224231 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.224910 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.225092 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.225141 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:42.225271 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:42.225372 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:42.225427 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:42.225469 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 07:16:42.225489 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 07:16:42.230610 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:42.228065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:44151 (local address 127.9.142.130:42953)
0811 07:16:42.228135 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:42.228137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:42.228255 (+ 118us) server_negotiation.cc:407] Connection header received
0811 07:16:42.228329 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:42.228330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:42.228341 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:42.228385 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:42.228546 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.229051 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.229805 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.230047 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.230124 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:42.230342 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:42.230379 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:42.230440 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:42.230512 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 07:16:42.230531 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:16:42.230662 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:42.227984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42953 (local address 127.9.142.129:44151)
0811 07:16:42.228178 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:42.228194 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:42.228277 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:42.228401 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:42.228402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:42.228403 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:16:42.228480 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:42.228481 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.229136 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.229137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:42.229712 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:42.229714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.230165 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.230166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:42.230233 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:42.230247 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:16:42.230458 (+ 211us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:16:42.230460 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:16:42.230498 (+ 38us) client_negotiation.cc:240] Negotiation successful
0811 07:16:42.230542 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":97,"threads_started":1}
I20260811 07:16:42.232576 13421 raft_consensus.cc:1261] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Refusing update from remote peer 03d6ced1cfcb4ce3b454b547e23f4a71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:42.232563 13662 raft_consensus.cc:1261] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Refusing update from remote peer 03d6ced1cfcb4ce3b454b547e23f4a71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:42.232897 13875 consensus_queue.cc:1035] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:42.233070 13793 consensus_queue.cc:1035] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:42.234535 13828 mvcc.cc:205] Tried to move back new op lower bound from 7317227938743128064 to 7317227938638364672. Current Snapshot: MvccSnapshot[applied={T|T < 7317227938743128064}]
I20260811 07:16:42.240291 13777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:42.238165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:57797 (local address 127.9.142.129:34351)
0811 07:16:42.238224 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:42.238227 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:42.238235 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:16:42.238256 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:42.238257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:42.238266 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:42.238321 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:42.238454 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.238918 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.239584 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.239858 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.239931 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:42.240070 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:42.240103 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:42.240152 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:42.240215 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 07:16:42.240233 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 07:16:42.240341 13858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:42.237979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:34351 (local address 127.9.142.130:57797)
0811 07:16:42.238022 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:42.238033 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:42.238072 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:42.238345 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:42.238346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:42.238347 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:16:42.238385 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:42.238386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.238985 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.238986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:42.239508 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:42.239509 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:42.239933 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:42.239934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:42.239988 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:42.239995 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:16:42.240158 (+ 163us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:16:42.240161 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:16:42.240203 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 07:16:42.240254 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 07:16:42.240674 13829 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 07:16:43.760051 12904 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:43.760164 12904 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:43.761035 12904 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: Sending DeleteTablet for 3 replicas of tablet 5b60b058cac4482ca8c8a7d0aed5b0e6
I20260811 07:16:43.761312 13148 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b60b058cac4482ca8c8a7d0aed5b0e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:43 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:50496
I20260811 07:16:43.761406 13389 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b60b058cac4482ca8c8a7d0aed5b0e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:43 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:43868
I20260811 07:16:43.761415 13631 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b60b058cac4482ca8c8a7d0aed5b0e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:43 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:33210
I20260811 07:16:43.761551 13920 tablet_replica.cc:330] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: stopping tablet replica
I20260811 07:16:43.761612 13920 raft_consensus.cc:2229] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:16:43.761631 13921 tablet_replica.cc:330] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: stopping tablet replica
I20260811 07:16:43.761682 13921 raft_consensus.cc:2229] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:43.761715 13921 raft_consensus.cc:2258] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:43.761716 13920 raft_consensus.cc:2258] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:43.761909 13922 tablet_replica.cc:330] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: stopping tablet replica
I20260811 07:16:43.761973 13922 raft_consensus.cc:2229] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:43.761971 13921 ts_tablet_manager.cc:1905] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:43.762009 13922 raft_consensus.cc:2258] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:43.762249 13922 ts_tablet_manager.cc:1905] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:43.763837 13921 ts_tablet_manager.cc:1918] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:16:43.763914 13921 log.cc:1196] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/5b60b058cac4482ca8c8a7d0aed5b0e6
I20260811 07:16:43.763980 13922 ts_tablet_manager.cc:1918] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:16:43.764050 13922 log.cc:1196] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/5b60b058cac4482ca8c8a7d0aed5b0e6
I20260811 07:16:43.764178 13921 ts_tablet_manager.cc:1939] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 44806ef39dc04b598fc25d877e14756c: Deleting consensus metadata
I20260811 07:16:43.764268 13922 ts_tablet_manager.cc:1939] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting consensus metadata
I20260811 07:16:43.764518 12887 catalog_manager.cc:4841] TS 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649): tablet 5b60b058cac4482ca8c8a7d0aed5b0e6 (table test-table [id=0661bf77d65149b9ac2dbd880b6bb13f]) successfully deleted
I20260811 07:16:43.764580 12884 catalog_manager.cc:4841] TS 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953): tablet 5b60b058cac4482ca8c8a7d0aed5b0e6 (table test-table [id=0661bf77d65149b9ac2dbd880b6bb13f]) successfully deleted
I20260811 07:16:43.764729 13920 ts_tablet_manager.cc:1905] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:43.766055 13920 ts_tablet_manager.cc:1918] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:16:43.766120 13920 log.cc:1196] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/5b60b058cac4482ca8c8a7d0aed5b0e6
I20260811 07:16:43.766417 13920 ts_tablet_manager.cc:1939] T 5b60b058cac4482ca8c8a7d0aed5b0e6 P 03d6ced1cfcb4ce3b454b547e23f4a71: Deleting consensus metadata
I20260811 07:16:43.766799 12882 catalog_manager.cc:4841] TS 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351): tablet 5b60b058cac4482ca8c8a7d0aed5b0e6 (table test-table [id=0661bf77d65149b9ac2dbd880b6bb13f]) successfully deleted
Aug 11 07:16:43 dist-test-slave-7f01 krb5kdc[12823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432603, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:16:43 dist-test-slave-7f01 krb5kdc[12823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432603, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:43.795984 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:43.780747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49156 (local address 127.9.142.190:38945)
0811 07:16:43.780906 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:43.780908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:43.780918 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:16:43.780998 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:43.780999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:43.781010 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:43.781081 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:43.781633 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:43.782227 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:43.783525 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:43.783800 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:43.783874 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:43.792418 (+ 8544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:43.792420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:43.792421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:43.792430 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:43.794487 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:43.794989 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:43.794990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:43.794991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:43.795056 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:43.795286 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:43.795286 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:43.795287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:43.795434 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:43.795537 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:43.795712 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 07:16:43.795843 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":101,"threads_started":1}
I20260811 07:16:43.799372 12904 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:16:43.799650 12904 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:43.801630 13148 tablet_service.cc:1467] Processing CreateTablet for tablet 50e7b6ce641d4c9baa482021664be213 (DEFAULT_TABLE table=test-table [id=e90e5f71fad2481bb3ca40e44ec76cce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:43.801664 13631 tablet_service.cc:1467] Processing CreateTablet for tablet 50e7b6ce641d4c9baa482021664be213 (DEFAULT_TABLE table=test-table [id=e90e5f71fad2481bb3ca40e44ec76cce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:43.801800 13631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e7b6ce641d4c9baa482021664be213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:43.801801 13148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e7b6ce641d4c9baa482021664be213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:43.801914 13389 tablet_service.cc:1467] Processing CreateTablet for tablet 50e7b6ce641d4c9baa482021664be213 (DEFAULT_TABLE table=test-table [id=e90e5f71fad2481bb3ca40e44ec76cce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:43.802067 13389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e7b6ce641d4c9baa482021664be213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:43.803278 13935 tablet_bootstrap.cc:492] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Bootstrap starting.
I20260811 07:16:43.803521 13937 tablet_bootstrap.cc:492] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: Bootstrap starting.
I20260811 07:16:43.803789 13938 tablet_bootstrap.cc:492] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: Bootstrap starting.
I20260811 07:16:43.803972 13935 tablet_bootstrap.cc:654] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:43.804026 13937 tablet_bootstrap.cc:654] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:43.804157 13938 tablet_bootstrap.cc:654] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:43.804760 13937 tablet_bootstrap.cc:492] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: No bootstrap required, opened a new log
I20260811 07:16:43.804818 13937 ts_tablet_manager.cc:1397] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:43.804828 13935 tablet_bootstrap.cc:492] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: No bootstrap required, opened a new log
I20260811 07:16:43.804879 13935 ts_tablet_manager.cc:1397] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:16:43.804921 13938 tablet_bootstrap.cc:492] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: No bootstrap required, opened a new log
I20260811 07:16:43.804970 13938 ts_tablet_manager.cc:1397] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:43.804960 13937 raft_consensus.cc:348] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.805047 13937 raft_consensus.cc:374] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:43.805076 13937 raft_consensus.cc:729] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44806ef39dc04b598fc25d877e14756c, State: Initialized, Role: FOLLOWER
I20260811 07:16:43.805032 13935 raft_consensus.cc:348] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.805105 13935 raft_consensus.cc:374] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:43.805075 13938 raft_consensus.cc:348] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.805125 13935 raft_consensus.cc:729] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114cd5f29a2c47b2a4e3cf7fb8e9da34, State: Initialized, Role: FOLLOWER
I20260811 07:16:43.805145 13938 raft_consensus.cc:374] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:43.805135 13937 consensus_queue.cc:260] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.805172 13938 raft_consensus.cc:729] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d6ced1cfcb4ce3b454b547e23f4a71, State: Initialized, Role: FOLLOWER
I20260811 07:16:43.805181 13935 consensus_queue.cc:260] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.805239 13938 consensus_queue.cc:260] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.805335 13938 ts_tablet_manager.cc:1428] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:43.805333 13937 ts_tablet_manager.cc:1428] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:43.805284 13935 ts_tablet_manager.cc:1428] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:43.819933 13944 raft_consensus.cc:482] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:43.820065 13944 raft_consensus.cc:504] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.820258 13944 leader_election.cc:288] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351), 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953)
I20260811 07:16:43.820464 13182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e7b6ce641d4c9baa482021664be213" candidate_uuid: "44806ef39dc04b598fc25d877e14756c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" is_pre_election: true
I20260811 07:16:43.820575 13182 raft_consensus.cc:2454] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44806ef39dc04b598fc25d877e14756c in term 0.
I20260811 07:16:43.820585 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e7b6ce641d4c9baa482021664be213" candidate_uuid: "44806ef39dc04b598fc25d877e14756c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" is_pre_election: true
I20260811 07:16:43.820675 13421 raft_consensus.cc:2454] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44806ef39dc04b598fc25d877e14756c in term 0.
I20260811 07:16:43.820858 13541 leader_election.cc:302] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114cd5f29a2c47b2a4e3cf7fb8e9da34, 44806ef39dc04b598fc25d877e14756c; no voters:
I20260811 07:16:43.821013 13944 raft_consensus.cc:2781] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:43.821060 13944 raft_consensus.cc:482] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:43.821089 13944 raft_consensus.cc:3037] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:43.821947 13944 raft_consensus.cc:504] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.822109 13944 leader_election.cc:288] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [CANDIDATE]: Term 1 election: Requested vote from peers 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351), 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953)
I20260811 07:16:43.822263 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e7b6ce641d4c9baa482021664be213" candidate_uuid: "44806ef39dc04b598fc25d877e14756c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34"
I20260811 07:16:43.822358 13421 raft_consensus.cc:3037] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:43.822335 13182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e7b6ce641d4c9baa482021664be213" candidate_uuid: "44806ef39dc04b598fc25d877e14756c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71"
I20260811 07:16:43.822631 13182 raft_consensus.cc:3037] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:43.823203 13421 raft_consensus.cc:2454] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44806ef39dc04b598fc25d877e14756c in term 1.
I20260811 07:16:43.823387 13541 leader_election.cc:302] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 114cd5f29a2c47b2a4e3cf7fb8e9da34, 44806ef39dc04b598fc25d877e14756c; no voters:
I20260811 07:16:43.823485 13944 raft_consensus.cc:2781] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:43.823628 13944 raft_consensus.cc:686] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 1 LEADER]: Becoming Leader. State: Replica: 44806ef39dc04b598fc25d877e14756c, State: Running, Role: LEADER
I20260811 07:16:43.823696 13944 consensus_queue.cc:237] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.823895 13182 raft_consensus.cc:2454] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44806ef39dc04b598fc25d877e14756c in term 1.
I20260811 07:16:43.824577 12902 catalog_manager.cc:5495] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c reported cstate change: term changed from 0 to 1, leader changed from <none> to 44806ef39dc04b598fc25d877e14756c (127.9.142.131). New cstate: current_term: 1 leader_uuid: "44806ef39dc04b598fc25d877e14756c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } health_report { overall_health: HEALTHY } } }
I20260811 07:16:43.836668 13949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:43.833405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33230 (local address 127.9.142.131:43649)
0811 07:16:43.833637 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:43.833639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:43.833651 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:16:43.833685 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:43.833685 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:43.833697 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:43.833788 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:43.833981 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:43.834662 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:43.835726 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:43.836123 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:43.836189 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:43.836373 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:43.836410 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:43.836462 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:43.836536 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 07:16:43.836562 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":122,"threads_started":1}
I20260811 07:16:43.839455 13421 raft_consensus.cc:1261] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Refusing update from remote peer 44806ef39dc04b598fc25d877e14756c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:43.839576 13182 raft_consensus.cc:1261] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Refusing update from remote peer 44806ef39dc04b598fc25d877e14756c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:43.839716 13944 consensus_queue.cc:1035] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [LEADER]: Connected to new peer: Peer: permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:43.839900 13945 consensus_queue.cc:1035] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [LEADER]: Connected to new peer: Peer: permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:43.852360 12903 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:43.852502 12903 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:43.853199 12903 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: Sending DeleteTablet for 3 replicas of tablet 50e7b6ce641d4c9baa482021664be213
I20260811 07:16:43.853487 13631 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e7b6ce641d4c9baa482021664be213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:43 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:33210
I20260811 07:16:43.853497 13148 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e7b6ce641d4c9baa482021664be213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:43 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:50496
I20260811 07:16:43.853628 13921 tablet_replica.cc:330] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: stopping tablet replica
I20260811 07:16:43.853652 13389 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e7b6ce641d4c9baa482021664be213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:43 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:43868
I20260811 07:16:43.853705 13921 raft_consensus.cc:2229] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:16:43.853763 13921 raft_consensus.cc:2258] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:43.853760 13922 tablet_replica.cc:330] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: stopping tablet replica
I20260811 07:16:43.853829 13922 raft_consensus.cc:2229] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:43.853843 13920 tablet_replica.cc:330] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: stopping tablet replica
I20260811 07:16:43.853879 13922 raft_consensus.cc:2258] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:43.853906 13920 raft_consensus.cc:2229] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:43.853950 13920 raft_consensus.cc:2258] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:43.854312 13921 ts_tablet_manager.cc:1905] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:43.854323 13922 ts_tablet_manager.cc:1905] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:43.854512 13920 ts_tablet_manager.cc:1905] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:43.856361 13920 ts_tablet_manager.cc:1918] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:16:43.856361 13922 ts_tablet_manager.cc:1918] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:16:43.856422 13922 log.cc:1196] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/50e7b6ce641d4c9baa482021664be213
I20260811 07:16:43.856422 13920 log.cc:1196] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/50e7b6ce641d4c9baa482021664be213
I20260811 07:16:43.856514 13921 ts_tablet_manager.cc:1918] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:16:43.856585 13921 log.cc:1196] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/50e7b6ce641d4c9baa482021664be213
I20260811 07:16:43.856653 13920 ts_tablet_manager.cc:1939] T 50e7b6ce641d4c9baa482021664be213 P 03d6ced1cfcb4ce3b454b547e23f4a71: Deleting consensus metadata
I20260811 07:16:43.856653 13922 ts_tablet_manager.cc:1939] T 50e7b6ce641d4c9baa482021664be213 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting consensus metadata
I20260811 07:16:43.856866 13921 ts_tablet_manager.cc:1939] T 50e7b6ce641d4c9baa482021664be213 P 44806ef39dc04b598fc25d877e14756c: Deleting consensus metadata
I20260811 07:16:43.856920 12903 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:16:43.857087 12903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:43.857091 12882 catalog_manager.cc:4841] TS 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351): tablet 50e7b6ce641d4c9baa482021664be213 (table test-table [id=e90e5f71fad2481bb3ca40e44ec76cce]) successfully deleted
I20260811 07:16:43.857188 12887 catalog_manager.cc:4841] TS 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649): tablet 50e7b6ce641d4c9baa482021664be213 (table test-table [id=e90e5f71fad2481bb3ca40e44ec76cce]) successfully deleted
I20260811 07:16:43.857506 12884 catalog_manager.cc:4841] TS 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953): tablet 50e7b6ce641d4c9baa482021664be213 (table test-table [id=e90e5f71fad2481bb3ca40e44ec76cce]) successfully deleted
I20260811 07:16:43.858590 13148 tablet_service.cc:1467] Processing CreateTablet for tablet d8f6ef00cc944337905ae2c3cc0f7de1 (DEFAULT_TABLE table=test-table [id=cc802bb7c95147e5889dd0cf7017d5cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:43.858590 13631 tablet_service.cc:1467] Processing CreateTablet for tablet d8f6ef00cc944337905ae2c3cc0f7de1 (DEFAULT_TABLE table=test-table [id=cc802bb7c95147e5889dd0cf7017d5cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:43.858665 13389 tablet_service.cc:1467] Processing CreateTablet for tablet d8f6ef00cc944337905ae2c3cc0f7de1 (DEFAULT_TABLE table=test-table [id=cc802bb7c95147e5889dd0cf7017d5cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:43.858721 13148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f6ef00cc944337905ae2c3cc0f7de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:43.858721 13631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f6ef00cc944337905ae2c3cc0f7de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:43.858794 13389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f6ef00cc944337905ae2c3cc0f7de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:43.859928 13935 tablet_bootstrap.cc:492] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Bootstrap starting.
I20260811 07:16:43.860321 13938 tablet_bootstrap.cc:492] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71: Bootstrap starting.
I20260811 07:16:43.860381 13935 tablet_bootstrap.cc:654] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:43.860704 13938 tablet_bootstrap.cc:654] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:43.860939 13937 tablet_bootstrap.cc:492] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: Bootstrap starting.
I20260811 07:16:43.861296 13937 tablet_bootstrap.cc:654] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:43.861346 13935 tablet_bootstrap.cc:492] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: No bootstrap required, opened a new log
I20260811 07:16:43.861398 13935 ts_tablet_manager.cc:1397] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:43.861559 13935 raft_consensus.cc:348] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.861653 13935 raft_consensus.cc:374] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:43.861685 13935 raft_consensus.cc:729] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 114cd5f29a2c47b2a4e3cf7fb8e9da34, State: Initialized, Role: FOLLOWER
I20260811 07:16:43.861733 13935 consensus_queue.cc:260] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.861857 13935 ts_tablet_manager.cc:1428] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:43.862146 13937 tablet_bootstrap.cc:492] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: No bootstrap required, opened a new log
I20260811 07:16:43.862208 13937 ts_tablet_manager.cc:1397] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:43.862218 13938 tablet_bootstrap.cc:492] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71: No bootstrap required, opened a new log
I20260811 07:16:43.862267 13938 ts_tablet_manager.cc:1397] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:16:43.862320 13937 raft_consensus.cc:348] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.862403 13937 raft_consensus.cc:374] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:43.862430 13937 raft_consensus.cc:729] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44806ef39dc04b598fc25d877e14756c, State: Initialized, Role: FOLLOWER
I20260811 07:16:43.862479 13937 consensus_queue.cc:260] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.862380 13938 raft_consensus.cc:348] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.862589 13938 raft_consensus.cc:374] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:43.862598 13937 ts_tablet_manager.cc:1428] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:43.862618 13938 raft_consensus.cc:729] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d6ced1cfcb4ce3b454b547e23f4a71, State: Initialized, Role: FOLLOWER
I20260811 07:16:43.862673 13938 consensus_queue.cc:260] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.862779 13938 ts_tablet_manager.cc:1428] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:43.891924 13907 raft_consensus.cc:482] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:43.892077 13907 raft_consensus.cc:504] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.892323 13907 leader_election.cc:288] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953), 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649)
I20260811 07:16:43.892560 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f6ef00cc944337905ae2c3cc0f7de1" candidate_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" is_pre_election: true
I20260811 07:16:43.892712 13421 raft_consensus.cc:2454] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03d6ced1cfcb4ce3b454b547e23f4a71 in term 0.
I20260811 07:16:43.892668 13662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f6ef00cc944337905ae2c3cc0f7de1" candidate_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44806ef39dc04b598fc25d877e14756c" is_pre_election: true
I20260811 07:16:43.892769 13662 raft_consensus.cc:2454] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03d6ced1cfcb4ce3b454b547e23f4a71 in term 0.
I20260811 07:16:43.893031 13060 leader_election.cc:302] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03d6ced1cfcb4ce3b454b547e23f4a71, 114cd5f29a2c47b2a4e3cf7fb8e9da34; no voters:
I20260811 07:16:43.893162 13907 raft_consensus.cc:2781] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:43.893203 13907 raft_consensus.cc:482] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:43.893224 13907 raft_consensus.cc:3037] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:43.893997 13907 raft_consensus.cc:504] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.894151 13907 leader_election.cc:288] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [CANDIDATE]: Term 1 election: Requested vote from peers 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953), 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649)
I20260811 07:16:43.894318 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f6ef00cc944337905ae2c3cc0f7de1" candidate_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34"
I20260811 07:16:43.894351 13662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f6ef00cc944337905ae2c3cc0f7de1" candidate_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44806ef39dc04b598fc25d877e14756c"
I20260811 07:16:43.894433 13421 raft_consensus.cc:3037] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:43.894433 13662 raft_consensus.cc:3037] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:43.895341 13421 raft_consensus.cc:2454] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d6ced1cfcb4ce3b454b547e23f4a71 in term 1.
I20260811 07:16:43.895341 13662 raft_consensus.cc:2454] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d6ced1cfcb4ce3b454b547e23f4a71 in term 1.
I20260811 07:16:43.895666 13060 leader_election.cc:302] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03d6ced1cfcb4ce3b454b547e23f4a71, 114cd5f29a2c47b2a4e3cf7fb8e9da34; no voters:
I20260811 07:16:43.895840 13907 raft_consensus.cc:2781] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:43.895906 13907 raft_consensus.cc:686] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [term 1 LEADER]: Becoming Leader. State: Replica: 03d6ced1cfcb4ce3b454b547e23f4a71, State: Running, Role: LEADER
I20260811 07:16:43.895972 13907 consensus_queue.cc:237] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } }
I20260811 07:16:43.896673 12902 catalog_manager.cc:5495] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129). New cstate: current_term: 1 leader_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d6ced1cfcb4ce3b454b547e23f4a71" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 } health_report { overall_health: UNKNOWN } } }
I20260811 07:16:43.914227 13971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:43.911335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50504 (local address 127.9.142.129:34351)
0811 07:16:43.911635 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:43.911637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:43.911646 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:16:43.911668 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:43.911668 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:43.911680 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:43.911809 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:43.912018 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:43.912588 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:43.913493 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:43.913708 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:43.913770 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:43.913915 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:43.913946 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:43.913988 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:43.914048 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 07:16:43.914074 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":154,"threads_started":1}
I20260811 07:16:43.917305 13421 raft_consensus.cc:1261] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Refusing update from remote peer 03d6ced1cfcb4ce3b454b547e23f4a71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:43.917320 13662 raft_consensus.cc:1261] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Refusing update from remote peer 03d6ced1cfcb4ce3b454b547e23f4a71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:43.917645 13907 consensus_queue.cc:1035] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "114cd5f29a2c47b2a4e3cf7fb8e9da34" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:43.917759 13904 consensus_queue.cc:1035] T d8f6ef00cc944337905ae2c3cc0f7de1 P 03d6ced1cfcb4ce3b454b547e23f4a71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44806ef39dc04b598fc25d877e14756c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:16:43.923074 13892 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 07:16:45.444638 12902 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:45.444782 12902 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:45.445771 12902 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7aff7cd415244429d4dd92f02945d9d: Sending DeleteTablet for 3 replicas of tablet d8f6ef00cc944337905ae2c3cc0f7de1
I20260811 07:16:45.446058 13384 tablet_service.cc:1514] Processing DeleteTablet for tablet d8f6ef00cc944337905ae2c3cc0f7de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:45 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:43868
I20260811 07:16:45.446054 13148 tablet_service.cc:1514] Processing DeleteTablet for tablet d8f6ef00cc944337905ae2c3cc0f7de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:45 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:50496
I20260811 07:16:45.446240 13631 tablet_service.cc:1514] Processing DeleteTablet for tablet d8f6ef00cc944337905ae2c3cc0f7de1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:45 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:33210
I20260811 07:16:45.446266 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 13034
I20260811 07:16:45.457703 14018 tablet_replica.cc:330] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: stopping tablet replica
I20260811 07:16:45.457795 14018 raft_consensus.cc:2229] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:45.457862 14018 raft_consensus.cc:2258] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:45.457991 14021 tablet_replica.cc:330] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: stopping tablet replica
I20260811 07:16:45.458060 14021 raft_consensus.cc:2229] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:45.458106 14021 raft_consensus.cc:2258] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:45.458248 14018 ts_tablet_manager.cc:1905] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:45.458410 14021 ts_tablet_manager.cc:1905] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:45.460088 14021 ts_tablet_manager.cc:1918] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:16:45.460078 14018 ts_tablet_manager.cc:1918] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:16:45.460150 14018 log.cc:1196] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/d8f6ef00cc944337905ae2c3cc0f7de1
I20260811 07:16:45.460150 14021 log.cc:1196] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/d8f6ef00cc944337905ae2c3cc0f7de1
I20260811 07:16:45.460389 14021 ts_tablet_manager.cc:1939] T d8f6ef00cc944337905ae2c3cc0f7de1 P 44806ef39dc04b598fc25d877e14756c: Deleting consensus metadata
I20260811 07:16:45.460389 14018 ts_tablet_manager.cc:1939] T d8f6ef00cc944337905ae2c3cc0f7de1 P 114cd5f29a2c47b2a4e3cf7fb8e9da34: Deleting consensus metadata
I20260811 07:16:45.460923 12887 catalog_manager.cc:4841] TS 44806ef39dc04b598fc25d877e14756c (127.9.142.131:43649): tablet d8f6ef00cc944337905ae2c3cc0f7de1 (table test-table [id=cc802bb7c95147e5889dd0cf7017d5cc]) successfully deleted
I20260811 07:16:45.460985 12884 catalog_manager.cc:4841] TS 114cd5f29a2c47b2a4e3cf7fb8e9da34 (127.9.142.130:42953): tablet d8f6ef00cc944337905ae2c3cc0f7de1 (table test-table [id=cc802bb7c95147e5889dd0cf7017d5cc]) successfully deleted
W20260811 07:16:45.464514 12882 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:34351 (error 108)
I20260811 07:16:45.465225 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 13274
I20260811 07:16:45.465260 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:45.465007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:34351 (local address 127.0.0.1:50520)
0811 07:16:45.465149 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:45.465208 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:34351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":73,"threads_started":1}
W20260811 07:16:45.470602 12882 catalog_manager.cc:4584] TS 03d6ced1cfcb4ce3b454b547e23f4a71 (127.9.142.129:34351): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d8f6ef00cc944337905ae2c3cc0f7de1: Network error: Client connection negotiation failed: client connection to 127.9.142.129:34351: connect: Connection refused (error 111)
I20260811 07:16:45.480374 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 13517
I20260811 07:16:45.493733 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 12846
2026-08-11T07:16:45Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6041 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:45 dist-test-slave-7f01 krb5kdc[14030](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:45 dist-test-slave-7f01 krb5kdc[14030](info): set up 2 sockets
Aug 11 07:16:45 dist-test-slave-7f01 krb5kdc[14030](info): commencing operation
krb5kdc: starting...
W20260811 07:16:46.792236 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:46 dist-test-slave-7f01 krb5kdc[14030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:16:46.922129 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45981
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:45981
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:47.009156 14048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:47.009421 14048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:47.009462 14048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:47.010655 14048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:47.010726 14048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:47.010752 14048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:47.010782 14048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:47.010814 14048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:47.012411 14048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:45981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:47.012719 14048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:47.012969 14048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:16:47.018764 14048 server_base.cc:1034] running on GCE node
W20260811 07:16:47.018728 14061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:47.018683 14067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:47.018683 14063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:47.019212 14048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:47.019551 14048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:47.020745 14048 hybrid_clock.cc:648] HybridClock initialized: now 1786432607020717 us; error 68 us; skew 500 ppm
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432607, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:47.023955 14048 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:16:47.024552 14048 webserver.cc:460] Webserver started at http://127.9.142.190:43767/ using document root <none> and password file <none>
I20260811 07:16:47.024845 14048 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:47.024928 14048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:47.025102 14048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:47.026290 14048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "4e6f6899a37242d7aa554760aee83343"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "a9253841572665e042c27ed1ba3d2934"
server_key_iv: "c05747218d2c90c4c55c8785a36a49fc"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.026721 14048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "4e6f6899a37242d7aa554760aee83343"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "a9253841572665e042c27ed1ba3d2934"
server_key_iv: "c05747218d2c90c4c55c8785a36a49fc"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.028401 14048 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 07:16:47.029386 14080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.029876 14048 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:47.030047 14048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "4e6f6899a37242d7aa554760aee83343"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "a9253841572665e042c27ed1ba3d2934"
server_key_iv: "c05747218d2c90c4c55c8785a36a49fc"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.030139 14048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:47.057586 14048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:47.060920 14048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:47.061151 14048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:47.066118 14048 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:45981
I20260811 07:16:47.066169 14158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:45981 every 8 connection(s)
I20260811 07:16:47.066609 14048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:47.067734 14160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:47.067831 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14048
I20260811 07:16:47.067975 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:47.068192 9786 external_mini_cluster.cc:1428] Setting key 830f126b7d0c4fca68e854fb9017031e
I20260811 07:16:47.071691 14160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343: Bootstrap starting.
I20260811 07:16:47.072710 14160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:47.073072 14160 log.cc:824] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:47.073881 14160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343: No bootstrap required, opened a new log
I20260811 07:16:47.076026 14160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6f6899a37242d7aa554760aee83343" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45981 } }
I20260811 07:16:47.076227 14160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:47.076274 14160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e6f6899a37242d7aa554760aee83343, State: Initialized, Role: FOLLOWER
I20260811 07:16:47.076421 14160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6f6899a37242d7aa554760aee83343" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45981 } }
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:47.076546 14160 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:47.076587 14160 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:47.076654 14160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:47.077417 14160 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6f6899a37242d7aa554760aee83343" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45981 } }
I20260811 07:16:47.077562 14160 leader_election.cc:302] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e6f6899a37242d7aa554760aee83343; no voters:
I20260811 07:16:47.077790 14160 leader_election.cc:288] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:47.077824 14171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:47.077950 14171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [term 1 LEADER]: Becoming Leader. State: Replica: 4e6f6899a37242d7aa554760aee83343, State: Running, Role: LEADER
I20260811 07:16:47.078034 14171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6f6899a37242d7aa554760aee83343" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45981 } }
I20260811 07:16:47.078130 14160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:47.078419 14171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e6f6899a37242d7aa554760aee83343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6f6899a37242d7aa554760aee83343" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45981 } } }
I20260811 07:16:47.078528 14171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:47.078683 14171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e6f6899a37242d7aa554760aee83343. Latest consensus state: current_term: 1 leader_uuid: "4e6f6899a37242d7aa554760aee83343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6f6899a37242d7aa554760aee83343" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45981 } } }
I20260811 07:16:47.078773 14171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:47.078943 14182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:47.080083 14182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:47.082108 14182 catalog_manager.cc:1347] Generated new cluster ID: cd018db30e604de49ef190ca99b862d7
I20260811 07:16:47.082175 14182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:16:47.083218 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:47.068853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45472 (local address 127.9.142.190:45981)
0811 07:16:47.069076 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:47.069085 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:47.069115 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:16:47.069588 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:47.069596 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:47.069650 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:47.069778 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:47.070757 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.071859 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.073120 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.074020 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.074347 (+ 327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:47.077154 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:47.077158 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:47.077159 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:47.077171 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:47.081391 (+ 4220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:47.081881 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:47.081884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:47.081885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:47.082027 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:47.082288 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:47.082289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:47.082290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:47.082553 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:47.082712 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:47.082839 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 07:16:47.082986 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":96,"threads_started":1}
I20260811 07:16:47.102936 14182 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:47.103696 14182 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:47.107306 14182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e6f6899a37242d7aa554760aee83343: Generated new TSK 0
I20260811 07:16:47.107542 14182 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:16:47.143100 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45981
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:47.252949 14220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:47.253165 14220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:47.253188 14220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:47.254356 14220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:47.254402 14220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:47.254429 14220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:16:47.255941 14220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:47.256186 14220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:47.256441 14220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:47.261802 14228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:47.261808 14233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:47.261808 14230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:47.261827 14220 server_base.cc:1034] running on GCE node
I20260811 07:16:47.262496 14220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:47.262946 14220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:47.264159 14220 hybrid_clock.cc:648] HybridClock initialized: now 1786432607264138 us; error 42 us; skew 500 ppm
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432607, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:47.266862 14220 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:16:47.267297 14220 webserver.cc:460] Webserver started at http://127.9.142.129:36721/ using document root <none> and password file <none>
I20260811 07:16:47.267553 14220 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:47.267604 14220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:47.267789 14220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:47.268967 14220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "fc72b9df6e5a41f1b66bd5d43020342f"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "55a07a8783f88337b1962e9c197b3cfe"
server_key_iv: "de2b1819e9fe5f4d42c5d5a7afaa4130"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.269364 14220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "fc72b9df6e5a41f1b66bd5d43020342f"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "55a07a8783f88337b1962e9c197b3cfe"
server_key_iv: "de2b1819e9fe5f4d42c5d5a7afaa4130"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.270866 14220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:16:47.271924 14247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.272138 14220 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:47.272255 14220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "fc72b9df6e5a41f1b66bd5d43020342f"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "55a07a8783f88337b1962e9c197b3cfe"
server_key_iv: "de2b1819e9fe5f4d42c5d5a7afaa4130"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.272342 14220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:47.292109 14220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:47.294606 14220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:47.294782 14220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:47.295075 14220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:47.295445 14220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:47.295485 14220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.295508 14220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:47.295521 14220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.303251 14220 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:35961
I20260811 07:16:47.303376 14450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:35961 every 8 connection(s)
I20260811 07:16:47.303718 14220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:16:47.309669 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14220
I20260811 07:16:47.309805 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:16:47.310089 9786 external_mini_cluster.cc:1428] Setting key 7f8a50ada9d2a91d9bbc04b6335116d4
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432607, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:47.315155 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:47.304655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:60303 (local address 127.9.142.190:45981)
0811 07:16:47.304767 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:47.304769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:47.304955 (+ 186us) server_negotiation.cc:407] Connection header received
0811 07:16:47.306011 (+ 1056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:47.306013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:47.306025 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:47.306092 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:47.306807 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.307385 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.308643 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.308907 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.309042 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:47.312082 (+ 3040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:47.312083 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:47.312083 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:47.312092 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:47.313711 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:47.314148 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:47.314149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:47.314150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:47.314215 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:47.314487 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:47.314488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:47.314488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:47.314603 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:47.314683 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:47.314978 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 07:16:47.315064 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:16:47.315361 14454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:47.304565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45981 (local address 127.9.142.129:60303)
0811 07:16:47.304800 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:47.304854 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:47.305888 (+ 1034us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:47.306172 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:47.306176 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:47.306465 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:47.306695 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:47.306700 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.307524 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.307525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:47.308541 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:47.308544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.309064 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.309065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:47.309197 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:47.309791 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:47.309800 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:47.311977 (+ 2177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:47.313818 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:47.313827 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:47.313829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:47.314067 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:47.314292 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:47.314293 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:47.314293 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:47.314407 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:47.314674 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:47.314681 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:47.314829 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 07:16:47.314935 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 07:16:47.315104 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":95,"threads_started":1}
I20260811 07:16:47.315869 14452 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45981
I20260811 07:16:47.315975 14452 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:47.316185 14452 heartbeater.cc:511] Master 127.9.142.190:45981 requested a full tablet report, sending...
I20260811 07:16:47.316815 14108 ts_manager.cc:194] Registered new tserver with Master: fc72b9df6e5a41f1b66bd5d43020342f (127.9.142.129:35961)
I20260811 07:16:47.317819 14108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:60303
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:16:47.342247 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45981
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:47.427415 14467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:47.427651 14467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:47.427690 14467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:47.428915 14467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:47.428982 14467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:47.429028 14467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:16:47.430514 14467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:47.430778 14467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:47.431012 14467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:47.436393 14473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:47.436322 14474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:47.436434 14467 server_base.cc:1034] running on GCE node
W20260811 07:16:47.436318 14478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:47.436766 14467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:47.437011 14467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:47.438153 14467 hybrid_clock.cc:648] HybridClock initialized: now 1786432607438141 us; error 29 us; skew 500 ppm
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432607, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:47.440728 14467 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:16:47.441183 14467 webserver.cc:460] Webserver started at http://127.9.142.130:45429/ using document root <none> and password file <none>
I20260811 07:16:47.441412 14467 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:47.441490 14467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:47.441645 14467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:47.442677 14467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "6f90e469ca16416e8515dbd031b14255"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "9aebeaba1b294b30def5b6c99b02bd2f"
server_key_iv: "79ffddced1d9aebf115375be3facac95"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.443101 14467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "6f90e469ca16416e8515dbd031b14255"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "9aebeaba1b294b30def5b6c99b02bd2f"
server_key_iv: "79ffddced1d9aebf115375be3facac95"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.444528 14467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:16:47.445287 14488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.445494 14467 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:47.445604 14467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "6f90e469ca16416e8515dbd031b14255"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "9aebeaba1b294b30def5b6c99b02bd2f"
server_key_iv: "79ffddced1d9aebf115375be3facac95"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.445677 14467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:47.460808 14467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:47.463148 14467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:47.463313 14467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:47.463570 14467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:47.463899 14467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:47.463960 14467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.464001 14467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:47.464028 14467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.470254 14467 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:34245
I20260811 07:16:47.470320 14704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:34245 every 8 connection(s)
I20260811 07:16:47.470626 14467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432607, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:47.477934 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14467
I20260811 07:16:47.478020 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:16:47.478256 9786 external_mini_cluster.cc:1428] Setting key b0c1c0903103611af4df9ce3b1289705
I20260811 07:16:47.480448 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:47.471354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:35899 (local address 127.9.142.190:45981)
0811 07:16:47.471430 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:47.471432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:47.471666 (+ 234us) server_negotiation.cc:407] Connection header received
0811 07:16:47.472326 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:47.472327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:47.472337 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:47.472390 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:47.473282 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.473776 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.474828 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.475013 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.475065 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:47.477311 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:47.477313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:47.477313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:47.477319 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:47.479036 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:47.479455 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:47.479456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:47.479457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:47.479516 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:47.479782 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:47.479783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:47.479783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:47.479932 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:47.479989 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:47.480279 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 07:16:47.480359 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:16:47.480654 14710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:47.471313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45981 (local address 127.9.142.130:35899)
0811 07:16:47.471539 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:47.471577 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:47.472221 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:47.472441 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:47.472444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:47.473007 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:47.473196 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:47.473200 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.473870 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.473871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:47.474748 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:47.474751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.475110 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.475111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:47.475222 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:47.475824 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:47.475833 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:47.477222 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:47.479117 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:47.479124 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:47.479127 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:47.479356 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:47.479571 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:47.479572 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:47.479572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:47.479685 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:47.479994 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:47.480002 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:47.480140 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 07:16:47.480243 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 07:16:47.480399 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":126,"threads_started":1}
I20260811 07:16:47.481319 14706 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45981
I20260811 07:16:47.481431 14706 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:47.481628 14706 heartbeater.cc:511] Master 127.9.142.190:45981 requested a full tablet report, sending...
I20260811 07:16:47.482033 14108 ts_manager.cc:194] Registered new tserver with Master: 6f90e469ca16416e8515dbd031b14255 (127.9.142.130:34245)
I20260811 07:16:47.482425 14108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:35899
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:16:47.506529 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45981
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:47.592053 14718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:47.592288 14718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:47.592327 14718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:47.593528 14718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:47.593595 14718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:47.593642 14718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:16:47.595160 14718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:47.595439 14718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:47.595705 14718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:47.601302 14732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:47.601298 14727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:47.601275 14726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:47.601593 14718 server_base.cc:1034] running on GCE node
I20260811 07:16:47.601850 14718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:47.602133 14718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:47.603302 14718 hybrid_clock.cc:648] HybridClock initialized: now 1786432607603290 us; error 42 us; skew 500 ppm
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432607, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:47.606104 14718 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:16:47.606623 14718 webserver.cc:460] Webserver started at http://127.9.142.131:39011/ using document root <none> and password file <none>
I20260811 07:16:47.606987 14718 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:47.607061 14718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:47.607206 14718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:47.608492 14718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "80ffffaa38e44556affa102ef95fa8f8"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "e4748bb8afa54cd11f80bbd7d72a18b6"
server_key_iv: "705e7db434f19182341f555abca52637"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.608951 14718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "80ffffaa38e44556affa102ef95fa8f8"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "e4748bb8afa54cd11f80bbd7d72a18b6"
server_key_iv: "705e7db434f19182341f555abca52637"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.610441 14718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 07:16:47.611259 14745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.611475 14718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:47.611591 14718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "80ffffaa38e44556affa102ef95fa8f8"
format_stamp: "Formatted at 2026-08-11 07:16:47 on dist-test-slave-7f01"
server_key: "e4748bb8afa54cd11f80bbd7d72a18b6"
server_key_iv: "705e7db434f19182341f555abca52637"
server_key_version: "encryptionkey@0"
I20260811 07:16:47.611673 14718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:47.632759 14718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:47.635052 14718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:47.635226 14718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:47.635486 14718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:47.635839 14718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:47.635910 14718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.635952 14718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:47.635982 14718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:47.642144 14718 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:33531
I20260811 07:16:47.642230 14949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:33531 every 8 connection(s)
I20260811 07:16:47.642570 14718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432607, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:47.651904 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:47.643336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45981 (local address 127.9.142.131:54277)
0811 07:16:47.643511 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:47.643554 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:47.644125 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:47.644364 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:47.644368 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:47.644942 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:47.645150 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:47.645154 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.645849 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.645851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:47.646658 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:47.646661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.647123 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.647124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:47.647234 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:47.647705 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:47.647713 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:47.649143 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:47.650671 (+ 1528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:47.650677 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:47.650679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:47.650902 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:47.651086 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:47.651087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:47.651087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:47.651188 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:47.651397 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:47.651402 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:47.651518 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 07:16:47.651602 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 07:16:47.651720 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":104,"threads_started":1}
I20260811 07:16:47.651918 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:47.643390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:54277 (local address 127.9.142.190:45981)
0811 07:16:47.643438 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:47.643440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:47.643639 (+ 199us) server_negotiation.cc:407] Connection header received
0811 07:16:47.644245 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:47.644247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:47.644259 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:47.644304 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:47.645246 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.645749 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.646753 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:47.646990 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:47.647056 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:47.649250 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:47.649257 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:47.649257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:47.649264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:47.650597 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:47.650970 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:47.650971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:47.650971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:47.651026 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:47.651243 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:47.651243 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:47.651244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:47.651343 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:47.651397 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:47.651672 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 07:16:47.651852 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:16:47.652302 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14718
I20260811 07:16:47.652412 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:16:47.652617 14950 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45981
I20260811 07:16:47.652647 9786 external_mini_cluster.cc:1428] Setting key ce5ea192858f66fb35aa91fdfd00329c
I20260811 07:16:47.652729 14950 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:47.652931 14950 heartbeater.cc:511] Master 127.9.142.190:45981 requested a full tablet report, sending...
I20260811 07:16:47.653407 14107 ts_manager.cc:194] Registered new tserver with Master: 80ffffaa38e44556affa102ef95fa8f8 (127.9.142.131:33531)
I20260811 07:16:47.653803 14107 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:54277
I20260811 07:16:47.664539 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:16:47.677189 14168 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:16:47.676253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54396 (local address 127.9.142.190:45981)
0811 07:16:47.676310 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:47.676312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:47.676464 (+ 152us) server_negotiation.cc:407] Connection header received
0811 07:16:47.676511 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:47.676512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:47.676521 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:47.676571 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:47.677121 (+ 550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54396: BlockingRecv error: recv got EOF from 127.0.0.1:54396 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 07:16:47.678045 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14220
I20260811 07:16:47.692884 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14467
I20260811 07:16:47.701290 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14718
I20260811 07:16:47.714557 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14048
2026-08-11T07:16:47Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2210 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14969](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14969](info): set up 2 sockets
Aug 11 07:16:47 dist-test-slave-7f01 krb5kdc[14969](info): commencing operation
krb5kdc: starting...
W20260811 07:16:49.018688 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:49 dist-test-slave-7f01 krb5kdc[14969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:16:49.151388 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41195
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:41195
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:49.241292 14987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:49.241566 14987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:49.241609 14987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:49.242792 14987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:49.242864 14987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:49.242889 14987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:49.242924 14987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:49.242954 14987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:49.244481 14987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:41195
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:49.244762 14987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:49.244994 14987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:49.249868 14999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:49.249868 14995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:49.249966 14996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:49.250166 14987 server_base.cc:1034] running on GCE node
I20260811 07:16:49.250560 14987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:49.250844 14987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:49.252010 14987 hybrid_clock.cc:648] HybridClock initialized: now 1786432609251998 us; error 44 us; skew 500 ppm
Aug 11 07:16:49 dist-test-slave-7f01 krb5kdc[14969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432609, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:49.257335 14987 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:16:49.257843 14987 webserver.cc:460] Webserver started at http://127.9.142.190:38725/ using document root <none> and password file <none>
I20260811 07:16:49.258088 14987 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:49.258159 14987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:49.258323 14987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:49.259418 14987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225"
format_stamp: "Formatted at 2026-08-11 07:16:49 on dist-test-slave-7f01"
server_key: "d09c58ad663cdb899539ad169f4a4fa8"
server_key_iv: "a23ceb869b54f9ba8ff4755402338d88"
server_key_version: "encryptionkey@0"
I20260811 07:16:49.259889 14987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225"
format_stamp: "Formatted at 2026-08-11 07:16:49 on dist-test-slave-7f01"
server_key: "d09c58ad663cdb899539ad169f4a4fa8"
server_key_iv: "a23ceb869b54f9ba8ff4755402338d88"
server_key_version: "encryptionkey@0"
I20260811 07:16:49.261535 14987 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:49.262346 15006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:49.262593 14987 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:49.262712 14987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225"
format_stamp: "Formatted at 2026-08-11 07:16:49 on dist-test-slave-7f01"
server_key: "d09c58ad663cdb899539ad169f4a4fa8"
server_key_iv: "a23ceb869b54f9ba8ff4755402338d88"
server_key_version: "encryptionkey@0"
I20260811 07:16:49.262802 14987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:49.283638 14987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:49.286132 14987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:49.286310 14987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:49.290582 14987 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:41195
I20260811 07:16:49.290625 15089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:41195 every 8 connection(s)
I20260811 07:16:49.291018 14987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:49.292011 15092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:49.294428 15092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225: Bootstrap starting.
I20260811 07:16:49.295068 15092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:49.295378 15092 log.cc:824] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:49.296151 15092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225: No bootstrap required, opened a new log
I20260811 07:16:49.297511 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14987
I20260811 07:16:49.297618 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:49.297806 9786 external_mini_cluster.cc:1428] Setting key fab672874c16f1a3bf13873cb5606582
I20260811 07:16:49.297844 15092 raft_consensus.cc:348] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41195 } }
I20260811 07:16:49.298058 15092 raft_consensus.cc:374] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:49.298110 15092 raft_consensus.cc:729] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a12564e4fc2f4bbb9a4fa60de3a2e225, State: Initialized, Role: FOLLOWER
I20260811 07:16:49.298308 15092 consensus_queue.cc:260] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41195 } }
I20260811 07:16:49.298415 15092 raft_consensus.cc:388] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:49.298456 15092 raft_consensus.cc:482] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:49.298534 15092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:49.299100 15092 raft_consensus.cc:504] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41195 } }
I20260811 07:16:49.299232 15092 leader_election.cc:302] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a12564e4fc2f4bbb9a4fa60de3a2e225; no voters:
I20260811 07:16:49.299422 15092 leader_election.cc:288] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:49.299496 15104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:49.299701 15092 sys_catalog.cc:564] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:49.299708 15104 raft_consensus.cc:686] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [term 1 LEADER]: Becoming Leader. State: Replica: a12564e4fc2f4bbb9a4fa60de3a2e225, State: Running, Role: LEADER
I20260811 07:16:49.299932 15104 consensus_queue.cc:237] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41195 } }
I20260811 07:16:49.300350 15105 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41195 } } }
I20260811 07:16:49.300429 15105 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:49.300658 15107 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a12564e4fc2f4bbb9a4fa60de3a2e225. Latest consensus state: current_term: 1 leader_uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12564e4fc2f4bbb9a4fa60de3a2e225" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41195 } } }
I20260811 07:16:49.301103 15125 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:49.301676 15125 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:49.300776 15107 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:49.303727 15125 catalog_manager.cc:1347] Generated new cluster ID: 1a506386e2434bbfa2fb928648d7ec60
I20260811 07:16:49.303828 15125 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:16:49 dist-test-slave-7f01 krb5kdc[14969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:49.310521 15101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:49.298320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49424 (local address 127.9.142.190:41195)
0811 07:16:49.298908 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:49.298916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:49.298941 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:16:49.299035 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:49.299040 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:49.299081 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:49.299213 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:49.300133 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:49.301615 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:49.302652 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:49.303216 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:49.303350 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:49.306323 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:49.306328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:49.306328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:49.306343 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:49.308433 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:49.308840 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:49.308844 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:49.308844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:49.308948 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:49.309126 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:49.309127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:49.309127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:49.309422 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:49.309599 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:49.310128 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 07:16:49.310276 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":498,"threads_started":1}
I20260811 07:16:49.310910 15125 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:49.311609 15125 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:49.311625 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:16:49.317776 15125 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a12564e4fc2f4bbb9a4fa60de3a2e225: Generated new TSK 0
I20260811 07:16:49.317961 15125 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:16:49.329128 15101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:49.325159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49436 (local address 127.9.142.190:41195)
0811 07:16:49.325236 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:49.325238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:49.325375 (+ 137us) server_negotiation.cc:407] Connection header received
0811 07:16:49.325451 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:49.325451 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:49.325461 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:49.325512 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:49.325980 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:49.326480 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:49.327592 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:49.327870 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:49.327928 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:49.328645 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:49.328646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:49.328646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:49.328853 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:49.328870 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:49.328876 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:49.328930 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:49.329016 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 07:16:49.329038 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:16:49.332007 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14987
2026-08-11T07:16:49Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1624 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:49 dist-test-slave-7f01 krb5kdc[15151](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:49 dist-test-slave-7f01 krb5kdc[15151](info): set up 2 sockets
Aug 11 07:16:49 dist-test-slave-7f01 krb5kdc[15151](info): commencing operation
krb5kdc: starting...
W20260811 07:16:50.630426 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:50 dist-test-slave-7f01 krb5kdc[15151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:16:50.763610 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:46021
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:46021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:50.846167 15171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:50.846405 15171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:50.846446 15171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:50.847595 15171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:50.847666 15171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:50.847692 15171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:50.847721 15171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:50.847766 15171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:50.849247 15171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:46021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:46021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:50.849527 15171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:50.849749 15171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:50.854539 15179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:50.854576 15184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:50.854636 15171 server_base.cc:1034] running on GCE node
W20260811 07:16:50.854619 15181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:50.855033 15171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:50.855350 15171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:50.856521 15171 hybrid_clock.cc:648] HybridClock initialized: now 1786432610856498 us; error 53 us; skew 500 ppm
Aug 11 07:16:50 dist-test-slave-7f01 krb5kdc[15151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432610, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:50.859146 15171 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:16:50.859596 15171 webserver.cc:460] Webserver started at http://127.9.142.190:40921/ using document root <none> and password file <none>
I20260811 07:16:50.859874 15171 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:50.859946 15171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:50.860109 15171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:50.861122 15171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "d4c80c84d97349c4a293b1c56b015e21"
format_stamp: "Formatted at 2026-08-11 07:16:50 on dist-test-slave-7f01"
server_key: "1d5cf06ed7633b623a77489a33e1afcf"
server_key_iv: "25f902c9fb7b6aa854ab6cf71ccc2431"
server_key_version: "encryptionkey@0"
I20260811 07:16:50.861508 15171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "d4c80c84d97349c4a293b1c56b015e21"
format_stamp: "Formatted at 2026-08-11 07:16:50 on dist-test-slave-7f01"
server_key: "1d5cf06ed7633b623a77489a33e1afcf"
server_key_iv: "25f902c9fb7b6aa854ab6cf71ccc2431"
server_key_version: "encryptionkey@0"
I20260811 07:16:50.862890 15171 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:50.863790 15200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:50.864002 15171 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:50.864118 15171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "d4c80c84d97349c4a293b1c56b015e21"
format_stamp: "Formatted at 2026-08-11 07:16:50 on dist-test-slave-7f01"
server_key: "1d5cf06ed7633b623a77489a33e1afcf"
server_key_iv: "25f902c9fb7b6aa854ab6cf71ccc2431"
server_key_version: "encryptionkey@0"
I20260811 07:16:50.864204 15171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:50.874590 15171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:50.877025 15171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:50.877197 15171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:50.881409 15171 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:46021
I20260811 07:16:50.881451 15285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:46021 every 8 connection(s)
I20260811 07:16:50.881827 15171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:50.882866 15286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:50.885206 15286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21: Bootstrap starting.
I20260811 07:16:50.885742 15286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:50.886016 15286 log.cc:824] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:50.886837 15286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21: No bootstrap required, opened a new log
I20260811 07:16:50.888742 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15171
I20260811 07:16:50.888877 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:50.889072 9786 external_mini_cluster.cc:1428] Setting key 3776da44fd491148105d62b019cb85e5
I20260811 07:16:50.889874 15286 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c80c84d97349c4a293b1c56b015e21" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46021 } }
I20260811 07:16:50.890061 15286 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:50.890102 15286 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4c80c84d97349c4a293b1c56b015e21, State: Initialized, Role: FOLLOWER
I20260811 07:16:50.890249 15286 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c80c84d97349c4a293b1c56b015e21" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46021 } }
I20260811 07:16:50.890338 15286 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:50.890368 15286 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:50.890420 15286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:50.890971 15286 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c80c84d97349c4a293b1c56b015e21" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46021 } }
I20260811 07:16:50.891098 15286 leader_election.cc:302] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4c80c84d97349c4a293b1c56b015e21; no voters:
I20260811 07:16:50.891273 15286 leader_election.cc:288] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:50.891309 15295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:50.891443 15295 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [term 1 LEADER]: Becoming Leader. State: Replica: d4c80c84d97349c4a293b1c56b015e21, State: Running, Role: LEADER
I20260811 07:16:50.891546 15286 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:50.891541 15295 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c80c84d97349c4a293b1c56b015e21" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46021 } }
I20260811 07:16:50.891942 15295 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4c80c84d97349c4a293b1c56b015e21. Latest consensus state: current_term: 1 leader_uuid: "d4c80c84d97349c4a293b1c56b015e21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c80c84d97349c4a293b1c56b015e21" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46021 } } }
I20260811 07:16:50.891961 15298 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4c80c84d97349c4a293b1c56b015e21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4c80c84d97349c4a293b1c56b015e21" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46021 } } }
I20260811 07:16:50.892014 15295 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:50.892059 15298 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:50.892228 15304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:50.892725 15304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:50.895032 15304 catalog_manager.cc:1347] Generated new cluster ID: 1d53b74b52b74174a910f3e220ee55ec
I20260811 07:16:50.895090 15304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:16:50 dist-test-slave-7f01 krb5kdc[15151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:50.901104 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:50.889664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44780 (local address 127.9.142.190:46021)
0811 07:16:50.889902 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:50.889936 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:50.890334 (+ 398us) server_negotiation.cc:407] Connection header received
0811 07:16:50.890731 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:50.890737 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:50.890782 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:50.890930 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:50.891766 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:50.893221 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:50.894067 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:50.894485 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:50.894599 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:50.897425 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:50.897429 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:50.897429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:50.897440 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:50.899396 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:50.899888 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:50.899891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:50.899891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:50.900006 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:50.900234 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:50.900235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:50.900235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:50.900515 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:50.900653 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:50.900786 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 07:16:50.900920 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":98,"threads_started":1}
I20260811 07:16:50.918820 15304 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:50.919333 15304 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:50.924669 15304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4c80c84d97349c4a293b1c56b015e21: Generated new TSK 0
I20260811 07:16:50.924860 15304 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:16:50.954546 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:46021
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:51.038736 15332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:51.038945 15332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:51.038969 15332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:51.040047 15332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:51.040083 15332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:51.040108 15332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:16:51.041466 15332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:46021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:51.041644 15332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:51.041814 15332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:51.046820 15342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:51.046849 15345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:51.046849 15341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:51.046949 15332 server_base.cc:1034] running on GCE node
I20260811 07:16:51.047222 15332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:51.047461 15332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:51.048614 15332 hybrid_clock.cc:648] HybridClock initialized: now 1786432611048597 us; error 37 us; skew 500 ppm
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[15151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432611, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:51.051208 15332 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:16:51.051694 15332 webserver.cc:460] Webserver started at http://127.9.142.129:36353/ using document root <none> and password file <none>
I20260811 07:16:51.051957 15332 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:51.052006 15332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:51.052179 15332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:51.053206 15332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "df1cc19ab10c4d0bbe31958835c86531"
format_stamp: "Formatted at 2026-08-11 07:16:51 on dist-test-slave-7f01"
server_key: "b09281843ddd562e9ca7ef692185b0df"
server_key_iv: "e987c297f697effcc0c80ccffc1d91dd"
server_key_version: "encryptionkey@0"
I20260811 07:16:51.053622 15332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "df1cc19ab10c4d0bbe31958835c86531"
format_stamp: "Formatted at 2026-08-11 07:16:51 on dist-test-slave-7f01"
server_key: "b09281843ddd562e9ca7ef692185b0df"
server_key_iv: "e987c297f697effcc0c80ccffc1d91dd"
server_key_version: "encryptionkey@0"
I20260811 07:16:51.054999 15332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:51.055693 15358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:51.055912 15332 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:51.056032 15332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "df1cc19ab10c4d0bbe31958835c86531"
format_stamp: "Formatted at 2026-08-11 07:16:51 on dist-test-slave-7f01"
server_key: "b09281843ddd562e9ca7ef692185b0df"
server_key_iv: "e987c297f697effcc0c80ccffc1d91dd"
server_key_version: "encryptionkey@0"
I20260811 07:16:51.056110 15332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:51.084231 15332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:51.086212 15332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:51.086385 15332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:51.086647 15332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:51.087000 15332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:51.087059 15332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:51.087100 15332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:51.087131 15332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:51.093863 15332 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:37357
I20260811 07:16:51.093916 15552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:37357 every 8 connection(s)
I20260811 07:16:51.094247 15332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:16:51.099666 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15332
I20260811 07:16:51.099826 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:16:51.100041 9786 external_mini_cluster.cc:1428] Setting key 9ab8abae17f77c04b68dc5430baf9af5
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[15151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432611, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:51.104466 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:51.094972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:58405 (local address 127.9.142.190:46021)
0811 07:16:51.095034 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:51.095036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:51.095255 (+ 219us) server_negotiation.cc:407] Connection header received
0811 07:16:51.095843 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:51.095844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:51.095868 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:51.095925 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:51.096914 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.097449 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.098484 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.098709 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.098787 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:51.101381 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:51.101383 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:51.101383 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:51.101390 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:51.102866 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:51.103314 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:51.103315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:51.103316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:51.103381 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:51.103650 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:51.103651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:51.103652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:51.103828 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:51.103903 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:51.104191 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 07:16:51.104293 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 07:16:51.104707 15556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:51.094947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:46021 (local address 127.9.142.129:58405)
0811 07:16:51.095138 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:51.095175 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:51.095711 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:51.095993 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:51.095998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:51.096598 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:51.096791 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:51.096796 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.097556 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.097558 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:51.098389 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:51.098392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.098796 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.098797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:51.098930 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:51.099458 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:51.099466 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:51.101268 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:51.102971 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:51.102980 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:51.102982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:51.103219 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:51.103459 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:51.103460 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:51.103460 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:51.103574 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:51.103895 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:51.103903 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:51.104051 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 07:16:51.104166 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:16:51.104332 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":94,"threads_started":1}
I20260811 07:16:51.105437 15553 heartbeater.cc:347] Connected to a master server at 127.9.142.190:46021
I20260811 07:16:51.105557 15553 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:51.105760 15553 heartbeater.cc:511] Master 127.9.142.190:46021 requested a full tablet report, sending...
I20260811 07:16:51.106408 15230 ts_manager.cc:194] Registered new tserver with Master: df1cc19ab10c4d0bbe31958835c86531 (127.9.142.129:37357)
I20260811 07:16:51.107069 15230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:58405
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:16:51.130124 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:46021
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:51.220116 15560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:51.220335 15560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:51.220358 15560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:51.221524 15560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:51.221567 15560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:51.221594 15560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:16:51.223057 15560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:46021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:51.223302 15560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:51.223565 15560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:16:51.228945 15560 server_base.cc:1034] running on GCE node
W20260811 07:16:51.228873 15575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:51.228987 15579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:51.228928 15577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:51.229362 15560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:51.229676 15560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:51.230823 15560 hybrid_clock.cc:648] HybridClock initialized: now 1786432611230808 us; error 44 us; skew 500 ppm
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[15151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432611, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:51.233316 15560 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:16:51.233804 15560 webserver.cc:460] Webserver started at http://127.9.142.130:38539/ using document root <none> and password file <none>
I20260811 07:16:51.234038 15560 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:51.234108 15560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:51.234264 15560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:51.235296 15560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "20415adf37c24bea882278141cf3c49e"
format_stamp: "Formatted at 2026-08-11 07:16:51 on dist-test-slave-7f01"
server_key: "c830312aeb0a442a92cb8d422d36ce43"
server_key_iv: "b11d283dfb6f158119919778ffc3fdf2"
server_key_version: "encryptionkey@0"
I20260811 07:16:51.235677 15560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "20415adf37c24bea882278141cf3c49e"
format_stamp: "Formatted at 2026-08-11 07:16:51 on dist-test-slave-7f01"
server_key: "c830312aeb0a442a92cb8d422d36ce43"
server_key_iv: "b11d283dfb6f158119919778ffc3fdf2"
server_key_version: "encryptionkey@0"
I20260811 07:16:51.237076 15560 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:51.237815 15591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:51.237996 15560 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:51.238099 15560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "20415adf37c24bea882278141cf3c49e"
format_stamp: "Formatted at 2026-08-11 07:16:51 on dist-test-slave-7f01"
server_key: "c830312aeb0a442a92cb8d422d36ce43"
server_key_iv: "b11d283dfb6f158119919778ffc3fdf2"
server_key_version: "encryptionkey@0"
I20260811 07:16:51.238186 15560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:51.251672 15560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:51.253683 15560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:51.253851 15560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:51.254084 15560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:51.254420 15560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:51.254478 15560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:51.254511 15560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:51.254540 15560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:51.261314 15560 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:37089
I20260811 07:16:51.261374 15781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:37089 every 8 connection(s)
I20260811 07:16:51.261835 15560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:16:51.266359 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15560
I20260811 07:16:51.266502 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:16:51.266738 9786 external_mini_cluster.cc:1428] Setting key e21a1b00c1206e00b8e1a768071ce469
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[15151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432611, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:51.273260 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:51.262619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:36497 (local address 127.9.142.190:46021)
0811 07:16:51.262694 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:51.262697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:51.262912 (+ 215us) server_negotiation.cc:407] Connection header received
0811 07:16:51.263412 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:51.263413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:51.263423 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:51.263476 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:51.264540 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.265259 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.266496 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.266828 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.266925 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:51.269817 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:51.269818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:51.269818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:51.269826 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:51.271508 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:51.272128 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:51.272129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:51.272130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:51.272195 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:51.272558 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:51.272559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:51.272560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:51.272687 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:51.272746 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:51.273106 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 07:16:51.273189 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:16:51.273609 15786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:51.262591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:46021 (local address 127.9.142.130:36497)
0811 07:16:51.262781 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:51.262819 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:51.263310 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:51.263530 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:51.263534 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:51.264203 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:51.264425 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:51.264430 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.265504 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.265506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:51.266387 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:51.266391 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.266933 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.266935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:51.267073 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:51.267689 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:51.267701 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:51.269683 (+ 1982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:51.271617 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:51.271628 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:51.271631 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:51.271998 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:51.272279 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:51.272280 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:51.272280 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:51.272439 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:51.272757 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:51.272765 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:51.272946 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 07:16:51.273066 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 07:16:51.273293 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":98,"threads_started":1}
I20260811 07:16:51.274199 15782 heartbeater.cc:347] Connected to a master server at 127.9.142.190:46021
I20260811 07:16:51.274317 15782 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:51.274643 15782 heartbeater.cc:511] Master 127.9.142.190:46021 requested a full tablet report, sending...
I20260811 07:16:51.275202 15230 ts_manager.cc:194] Registered new tserver with Master: 20415adf37c24bea882278141cf3c49e (127.9.142.130:37089)
I20260811 07:16:51.275811 15230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:36497
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:16:51.299460 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:46021
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:35727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:51.392637 15791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:51.392940 15791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:51.392985 15791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:51.394484 15791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:51.394572 15791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:51.394620 15791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:16:51.396296 15791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:46021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:51.396575 15791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:51.396832 15791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:51.402237 15799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:51.402191 15800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:51.402343 15803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:51.402706 15791 server_base.cc:1034] running on GCE node
I20260811 07:16:51.402979 15791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:51.403275 15791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:51.404580 15791 hybrid_clock.cc:648] HybridClock initialized: now 1786432611404565 us; error 34 us; skew 500 ppm
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[15151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432611, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:51.407330 15791 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:16:51.407891 15791 webserver.cc:460] Webserver started at http://127.9.142.131:34841/ using document root <none> and password file <none>
I20260811 07:16:51.408097 15791 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:51.408139 15791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:51.408236 15791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:51.409322 15791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "a39b1db45bc041648778028962d881c2"
format_stamp: "Formatted at 2026-08-11 07:16:51 on dist-test-slave-7f01"
server_key: "81e155effd5e093a01ebe71f2deeb469"
server_key_iv: "d091f4c67e21119daeb320e2fbe8ff34"
server_key_version: "encryptionkey@0"
I20260811 07:16:51.409644 15791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "a39b1db45bc041648778028962d881c2"
format_stamp: "Formatted at 2026-08-11 07:16:51 on dist-test-slave-7f01"
server_key: "81e155effd5e093a01ebe71f2deeb469"
server_key_iv: "d091f4c67e21119daeb320e2fbe8ff34"
server_key_version: "encryptionkey@0"
I20260811 07:16:51.411073 15791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:51.412189 15812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:51.412539 15791 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:51.412667 15791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "a39b1db45bc041648778028962d881c2"
format_stamp: "Formatted at 2026-08-11 07:16:51 on dist-test-slave-7f01"
server_key: "81e155effd5e093a01ebe71f2deeb469"
server_key_iv: "d091f4c67e21119daeb320e2fbe8ff34"
server_key_version: "encryptionkey@0"
I20260811 07:16:51.412762 15791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:51.423243 15791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:51.426328 15791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:51.426496 15791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:51.426774 15791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:51.427132 15791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:51.427167 15791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:51.427191 15791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:51.427237 15791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:51.434020 15791 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:45023
I20260811 07:16:51.434142 16013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:45023 every 8 connection(s)
I20260811 07:16:51.434542 15791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:16:51.435971 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15791
I20260811 07:16:51.436059 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:16:51.436276 9786 external_mini_cluster.cc:1428] Setting key abcb7fc5d77423102bc1cd3507c49e43
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[15151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432611, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:51.444751 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:51.435449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:39027 (local address 127.9.142.190:46021)
0811 07:16:51.435515 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:51.435518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:51.435770 (+ 252us) server_negotiation.cc:407] Connection header received
0811 07:16:51.436451 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:51.436452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:51.436466 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:51.436525 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:51.437653 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.438171 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.439227 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.439424 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.439502 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:51.441839 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:51.441840 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:51.441841 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:51.441848 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:51.443376 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:51.443890 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:51.443892 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:51.443892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:51.443947 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:51.444194 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:51.444194 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:51.444194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:51.444299 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:51.444347 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:51.444620 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 07:16:51.444684 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:16:51.444936 16017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:51.435411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:46021 (local address 127.9.142.131:39027)
0811 07:16:51.435618 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:51.435658 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:51.436331 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:51.436596 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:51.436600 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:51.437337 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:51.437550 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:51.437556 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.438284 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.438285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:51.439122 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:51.439124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.439511 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.439512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:51.439639 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:51.440244 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:51.440253 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:51.441743 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:51.443469 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:51.443477 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:51.443480 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:51.443726 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:51.444011 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:51.444012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:51.444012 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:51.444128 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:51.444355 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:51.444360 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:51.444496 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 07:16:51.444578 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:16:51.444710 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
I20260811 07:16:51.445441 16014 heartbeater.cc:347] Connected to a master server at 127.9.142.190:46021
I20260811 07:16:51.445561 16014 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:51.445751 16014 heartbeater.cc:511] Master 127.9.142.190:46021 requested a full tablet report, sending...
I20260811 07:16:51.446138 15230 ts_manager.cc:194] Registered new tserver with Master: a39b1db45bc041648778028962d881c2 (127.9.142.131:45023)
I20260811 07:16:51.446489 15230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:39027
I20260811 07:16:51.448205 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[15151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432611, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[15151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432611, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:51.474776 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:51.467097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44782 (local address 127.9.142.190:46021)
0811 07:16:51.467187 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:51.467190 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:51.467306 (+ 116us) server_negotiation.cc:407] Connection header received
0811 07:16:51.467392 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:51.467393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:51.467407 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:51.467470 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:51.468144 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.468645 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.469398 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:51.469596 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:51.469661 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:51.472101 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:51.472103 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:51.472103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:51.472112 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:51.473530 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:51.473911 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:51.473912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:51.473913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:51.473973 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:51.474179 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:51.474179 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:51.474180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:51.474346 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:51.474462 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:51.474569 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 07:16:51.474655 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 07:16:51.475031 15230 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44782
I20260811 07:16:51.475526 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15332
I20260811 07:16:51.489584 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15560
I20260811 07:16:51.499004 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15791
I20260811 07:16:51.508610 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15171
2026-08-11T07:16:51Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2170 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[16032](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[16032](info): set up 2 sockets
Aug 11 07:16:51 dist-test-slave-7f01 krb5kdc[16032](info): commencing operation
krb5kdc: starting...
W20260811 07:16:52.849356 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:52 dist-test-slave-7f01 krb5kdc[16032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:16:52.981139 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:39823
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:46609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:39823
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:53.074448 16061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:53.074683 16061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:53.074708 16061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:53.076027 16061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:53.076076 16061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:53.076092 16061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:53.076104 16061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:53.076116 16061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:53.077708 16061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:46609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:39823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:39823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:53.078008 16061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:53.078265 16061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:53.083981 16069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:53.083989 16075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:53.084048 16072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:53.084183 16061 server_base.cc:1034] running on GCE node
I20260811 07:16:53.084554 16061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:53.085001 16061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:53.086194 16061 hybrid_clock.cc:648] HybridClock initialized: now 1786432613086178 us; error 32 us; skew 500 ppm
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:53.089771 16061 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:16:53.090534 16061 webserver.cc:460] Webserver started at http://127.9.142.190:33713/ using document root <none> and password file <none>
I20260811 07:16:53.090804 16061 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:53.090878 16061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:53.091060 16061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:53.092278 16061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "14c946487a3c48d1867075062d6ce7b0"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "db951c20ee92687fb1a6fdf12f6e6e36"
server_key_iv: "7e54ed01efec9aa2f956151eea7ee9a7"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.092664 16061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "14c946487a3c48d1867075062d6ce7b0"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "db951c20ee92687fb1a6fdf12f6e6e36"
server_key_iv: "7e54ed01efec9aa2f956151eea7ee9a7"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.094208 16061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:16:53.095155 16087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.095570 16061 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:53.095785 16061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "14c946487a3c48d1867075062d6ce7b0"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "db951c20ee92687fb1a6fdf12f6e6e36"
server_key_iv: "7e54ed01efec9aa2f956151eea7ee9a7"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.095908 16061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:53.108551 16061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:53.110994 16061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:53.111209 16061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:53.116016 16061 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:39823
I20260811 07:16:53.116139 16164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:39823 every 8 connection(s)
I20260811 07:16:53.116715 16061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:53.117609 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 16061
I20260811 07:16:53.117761 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:53.117969 16165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:53.118007 9786 external_mini_cluster.cc:1428] Setting key f1bf360ac4b842559b8cd7db0544441c
I20260811 07:16:53.122830 16165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0: Bootstrap starting.
I20260811 07:16:53.123710 16165 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:53.124111 16165 log.cc:824] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:53.125095 16165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0: No bootstrap required, opened a new log
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:53.128003 16165 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c946487a3c48d1867075062d6ce7b0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 39823 } }
I20260811 07:16:53.128216 16165 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:53.128268 16165 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c946487a3c48d1867075062d6ce7b0, State: Initialized, Role: FOLLOWER
I20260811 07:16:53.128434 16165 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c946487a3c48d1867075062d6ce7b0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 39823 } }
I20260811 07:16:53.128547 16165 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:53.128589 16165 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:53.128644 16165 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:53.129503 16165 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c946487a3c48d1867075062d6ce7b0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 39823 } }
I20260811 07:16:53.129638 16165 leader_election.cc:302] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14c946487a3c48d1867075062d6ce7b0; no voters:
I20260811 07:16:53.129877 16165 leader_election.cc:288] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:53.129938 16174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:53.130192 16165 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:53.130190 16174 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [term 1 LEADER]: Becoming Leader. State: Replica: 14c946487a3c48d1867075062d6ce7b0, State: Running, Role: LEADER
I20260811 07:16:53.130355 16174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c946487a3c48d1867075062d6ce7b0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 39823 } }
I20260811 07:16:53.130926 16177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14c946487a3c48d1867075062d6ce7b0. Latest consensus state: current_term: 1 leader_uuid: "14c946487a3c48d1867075062d6ce7b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c946487a3c48d1867075062d6ce7b0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 39823 } } }
I20260811 07:16:53.131031 16177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:53.131251 16191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:53.130818 16175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14c946487a3c48d1867075062d6ce7b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c946487a3c48d1867075062d6ce7b0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 39823 } } }
I20260811 07:16:53.131805 16175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:53.132017 16191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:53.132493 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:53.118834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45524 (local address 127.9.142.190:39823)
0811 07:16:53.119221 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:53.119233 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:53.119276 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:16:53.119952 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:53.119963 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:53.120034 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:53.120214 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:53.120930 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.122616 (+ 1686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.123521 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.124255 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.124406 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:53.127588 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:53.127594 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:53.127594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:53.127611 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:53.129980 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.130509 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.130513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.130514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.130631 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.130882 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.130883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.130883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.131266 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:53.131466 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:53.132092 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 07:16:53.132284 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":151,"threads_started":1}
I20260811 07:16:53.137039 16191 catalog_manager.cc:1347] Generated new cluster ID: 1553ef6f212c41bca4af957ea949f071
I20260811 07:16:53.137113 16191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:16:53.145009 16191 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:53.145771 16191 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:53.161742 16191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14c946487a3c48d1867075062d6ce7b0: Generated new TSK 0
I20260811 07:16:53.161969 16191 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:16:53.194504 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:39823
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:46609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:53.284585 16212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:53.284883 16212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:53.284934 16212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:53.286983 16212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:53.287074 16212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:53.287128 16212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:16:53.289113 16212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:46609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:39823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:53.289403 16212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:53.289661 16212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:53.295213 16221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:53.295259 16219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:53.295218 16218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:53.295629 16212 server_base.cc:1034] running on GCE node
I20260811 07:16:53.295899 16212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:53.296119 16212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:53.297325 16212 hybrid_clock.cc:648] HybridClock initialized: now 1786432613297303 us; error 42 us; skew 500 ppm
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:53.300372 16212 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:16:53.300899 16212 webserver.cc:460] Webserver started at http://127.9.142.129:43945/ using document root <none> and password file <none>
I20260811 07:16:53.301113 16212 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:53.301159 16212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:53.301260 16212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:53.302388 16212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "3e0cf9cdc3154dac8777ae867666b634"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "e8af1bec8dcb59952b4340d26e228678"
server_key_iv: "ce2f0b5e0d7316bc4cfdc4168d0c4194"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.302729 16212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "3e0cf9cdc3154dac8777ae867666b634"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "e8af1bec8dcb59952b4340d26e228678"
server_key_iv: "ce2f0b5e0d7316bc4cfdc4168d0c4194"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.304210 16212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:53.305063 16233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.305295 16212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:53.305400 16212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "3e0cf9cdc3154dac8777ae867666b634"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "e8af1bec8dcb59952b4340d26e228678"
server_key_iv: "ce2f0b5e0d7316bc4cfdc4168d0c4194"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.305461 16212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:53.315456 16212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:53.317884 16212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:53.318017 16212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:53.318222 16212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:53.318499 16212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:53.318532 16212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.318555 16212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:53.318567 16212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.325809 16212 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:46405
I20260811 07:16:53.325851 16422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:46405 every 8 connection(s)
I20260811 07:16:53.326269 16212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:16:53.331490 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 16212
I20260811 07:16:53.331636 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:16:53.331882 9786 external_mini_cluster.cc:1428] Setting key c28531c6a7e173bf01696af84408ac52
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:53.338400 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:53.327280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:44017 (local address 127.9.142.190:39823)
0811 07:16:53.327471 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:53.327474 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:53.327712 (+ 238us) server_negotiation.cc:407] Connection header received
0811 07:16:53.328929 (+ 1217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:53.328930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:53.328941 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:53.329008 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:53.329656 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.330199 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.331666 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.332041 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.332129 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:53.335010 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:53.335013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:53.335013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:53.335022 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:53.336771 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.337333 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.337334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.337334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.337397 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.337703 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.337703 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.337704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.337809 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:53.337886 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:53.338253 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 07:16:53.338333 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:16:53.338689 16428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:53.327226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:39823 (local address 127.9.142.129:44017)
0811 07:16:53.327571 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:53.327620 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:53.328823 (+ 1203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:53.329086 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:53.329090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:53.329353 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:53.329573 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:53.329577 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.330495 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.330497 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:53.331374 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:53.331377 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.332159 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.332161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:53.332351 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:53.333035 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:53.333044 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:53.334851 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:53.336896 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:53.336903 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:53.336906 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:53.337246 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:53.337471 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:53.337472 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:53.337473 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:53.337625 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:53.337906 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:53.337914 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:53.338096 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 07:16:53.338229 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 07:16:53.338422 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":247,"threads_started":1}
I20260811 07:16:53.339370 16423 heartbeater.cc:347] Connected to a master server at 127.9.142.190:39823
I20260811 07:16:53.339476 16423 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:53.339685 16423 heartbeater.cc:511] Master 127.9.142.190:39823 requested a full tablet report, sending...
I20260811 07:16:53.340307 16115 ts_manager.cc:194] Registered new tserver with Master: 3e0cf9cdc3154dac8777ae867666b634 (127.9.142.129:46405)
I20260811 07:16:53.341013 16115 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:44017
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:16:53.362885 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:39823
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:46609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:53.451377 16438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:53.451623 16438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:53.451663 16438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:53.452863 16438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:53.452934 16438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:53.452978 16438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:16:53.454530 16438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:46609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:39823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:53.454802 16438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:53.455044 16438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:53.460114 16444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:53.460083 16449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:53.460256 16438 server_base.cc:1034] running on GCE node
W20260811 07:16:53.460098 16447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:53.460520 16438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:53.460750 16438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:53.461902 16438 hybrid_clock.cc:648] HybridClock initialized: now 1786432613461885 us; error 37 us; skew 500 ppm
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:53.464547 16438 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:16:53.465026 16438 webserver.cc:460] Webserver started at http://127.9.142.130:38873/ using document root <none> and password file <none>
I20260811 07:16:53.465277 16438 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:53.465354 16438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:53.465502 16438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:53.466544 16438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "331ad6efb1e047148400f7318ba14382"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "062b7d968edeeace9a0a784cec431703"
server_key_iv: "ad1608d7aaa91f242077d80fb49415d4"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.466922 16438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "331ad6efb1e047148400f7318ba14382"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "062b7d968edeeace9a0a784cec431703"
server_key_iv: "ad1608d7aaa91f242077d80fb49415d4"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.468362 16438 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:16:53.469156 16457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.469347 16438 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:53.469451 16438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "331ad6efb1e047148400f7318ba14382"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "062b7d968edeeace9a0a784cec431703"
server_key_iv: "ad1608d7aaa91f242077d80fb49415d4"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.469532 16438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:53.477496 16438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:53.479945 16438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:53.480113 16438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:53.480403 16438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:53.480749 16438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:53.480805 16438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.480839 16438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:53.480870 16438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.487295 16438 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:44879
I20260811 07:16:53.487346 16664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:44879 every 8 connection(s)
I20260811 07:16:53.487679 16438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:16:53.489500 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 16438
I20260811 07:16:53.489640 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:16:53.489838 9786 external_mini_cluster.cc:1428] Setting key 2c0157bca4f4c0e4b0205266c6693d29
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:53.499334 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:53.488489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:44425 (local address 127.9.142.190:39823)
0811 07:16:53.488581 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:53.488583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:53.488751 (+ 168us) server_negotiation.cc:407] Connection header received
0811 07:16:53.490014 (+ 1263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:53.490015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:53.490043 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:53.490131 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:53.491021 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.491532 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.493007 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.493223 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.493312 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:53.496031 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:53.496032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:53.496032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:53.496039 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:53.497753 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.498197 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.498199 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.498200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.498269 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.498599 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.498600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.498600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.498751 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:53.498829 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:53.499143 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 07:16:53.499229 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:16:53.499420 16668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:53.488444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:39823 (local address 127.9.142.130:44425)
0811 07:16:53.488621 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:53.488664 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:53.489857 (+ 1193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:53.490238 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:53.490242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:53.490618 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:53.490926 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:53.490933 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.491623 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.491624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:53.492912 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:53.492915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.493325 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.493326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:53.493475 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:53.494079 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:53.494088 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:53.495937 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:53.497846 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:53.497853 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:53.497855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:53.498111 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:53.498341 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:53.498341 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:53.498342 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:53.498526 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:53.498825 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:53.498831 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:53.499000 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 07:16:53.499091 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 07:16:53.499220 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260811 07:16:53.499974 16665 heartbeater.cc:347] Connected to a master server at 127.9.142.190:39823
I20260811 07:16:53.500098 16665 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:53.500289 16665 heartbeater.cc:511] Master 127.9.142.190:39823 requested a full tablet report, sending...
I20260811 07:16:53.500726 16115 ts_manager.cc:194] Registered new tserver with Master: 331ad6efb1e047148400f7318ba14382 (127.9.142.130:44879)
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
I20260811 07:16:53.501251 16115 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:44425
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:16:53.518970 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:39823
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:46609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:53.604461 16671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:53.604673 16671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:53.604697 16671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:53.605793 16671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:53.605827 16671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:53.605852 16671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:16:53.607300 16671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:46609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:39823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:53.607560 16671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:53.607813 16671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:53.612920 16689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:53.613039 16686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:53.612949 16684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:53.613116 16671 server_base.cc:1034] running on GCE node
I20260811 07:16:53.613397 16671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:53.613659 16671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:53.614856 16671 hybrid_clock.cc:648] HybridClock initialized: now 1786432613614846 us; error 30 us; skew 500 ppm
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:53.617545 16671 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:16:53.618075 16671 webserver.cc:460] Webserver started at http://127.9.142.131:45485/ using document root <none> and password file <none>
I20260811 07:16:53.618321 16671 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:53.618391 16671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:53.618549 16671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:53.619644 16671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "93c3aa666d694d0c89ab6d30e880576f"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "8ac74e7c6d3158f00b7e4b9b6c883cd9"
server_key_iv: "ba8fdaa480b1ccf197a59c1944ed2829"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.620119 16671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "93c3aa666d694d0c89ab6d30e880576f"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "8ac74e7c6d3158f00b7e4b9b6c883cd9"
server_key_iv: "ba8fdaa480b1ccf197a59c1944ed2829"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.621523 16671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:53.622318 16699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.622504 16671 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:16:53.622622 16671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "93c3aa666d694d0c89ab6d30e880576f"
format_stamp: "Formatted at 2026-08-11 07:16:53 on dist-test-slave-7f01"
server_key: "8ac74e7c6d3158f00b7e4b9b6c883cd9"
server_key_iv: "ba8fdaa480b1ccf197a59c1944ed2829"
server_key_version: "encryptionkey@0"
I20260811 07:16:53.622699 16671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:53.633796 16671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:53.635885 16671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:53.636055 16671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:53.636302 16671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:53.636636 16671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:53.636691 16671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.636737 16671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:53.636761 16671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:53.643143 16671 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:33079
I20260811 07:16:53.643191 16884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:33079 every 8 connection(s)
I20260811 07:16:53.643515 16671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:16:53.644722 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 16671
I20260811 07:16:53.644837 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:16:53.645030 9786 external_mini_cluster.cc:1428] Setting key a0ed6456471b72da215461b146a216f3
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:53.653046 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:53.644360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:40707 (local address 127.9.142.190:39823)
0811 07:16:53.644406 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:53.644408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:53.644857 (+ 449us) server_negotiation.cc:407] Connection header received
0811 07:16:53.645793 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:53.645794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:53.645806 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:53.645873 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:53.646545 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.647056 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.648108 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.648284 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.648346 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:53.650372 (+ 2026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:53.650373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:53.650374 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:53.650380 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:53.651813 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.652169 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.652170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.652170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.652222 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.652469 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.652470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.652471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.652599 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:53.652671 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:53.652905 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 07:16:53.652975 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:16:53.653223 16890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:53.644338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:39823 (local address 127.9.142.131:40707)
0811 07:16:53.644492 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:53.644528 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:53.645663 (+ 1135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:53.645931 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:53.645935 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:53.646250 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:53.646456 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:53.646461 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.647141 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.647142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:53.648036 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:53.648039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.648373 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.648374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:53.648477 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:53.648943 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:53.648951 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:53.650290 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:53.651881 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:53.651888 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:53.651890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:53.652105 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:53.652283 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:53.652284 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:53.652284 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:53.652380 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:53.652670 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:53.652674 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:53.652783 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 07:16:53.652864 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 07:16:53.652999 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
I20260811 07:16:53.653800 16887 heartbeater.cc:347] Connected to a master server at 127.9.142.190:39823
I20260811 07:16:53.653887 16887 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:53.654095 16887 heartbeater.cc:511] Master 127.9.142.190:39823 requested a full tablet report, sending...
I20260811 07:16:53.654515 16115 ts_manager.cc:194] Registered new tserver with Master: 93c3aa666d694d0c89ab6d30e880576f (127.9.142.131:33079)
I20260811 07:16:53.654888 16115 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:40707
I20260811 07:16:53.657022 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:16:53.682436 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:53.674228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44524 (local address 127.9.142.129:46405)
0811 07:16:53.674402 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:53.674407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:53.674418 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:16:53.674446 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:53.674448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:53.674462 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:53.674538 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:53.675119 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.675986 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.676757 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.677090 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.677151 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:53.679458 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:53.679474 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:53.679474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:53.679482 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:53.681153 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.681554 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.681557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.681558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.681626 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.681842 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.681843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.681843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.681992 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:53.682156 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:53.682210 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 07:16:53.682295 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:53.690275 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:53.683884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45528 (local address 127.9.142.190:39823)
0811 07:16:53.683954 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:53.683956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:53.683991 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:16:53.684060 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:53.684061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:53.684074 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:53.684121 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:53.684536 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.685022 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.685658 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:53.685857 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:53.685913 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:53.688115 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:53.688117 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:53.688117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:53.688123 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:53.689284 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.689604 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.689605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.689605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.689659 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:53.689852 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:53.689853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:53.689853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:53.689993 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:53.690068 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:53.690155 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 07:16:53.690213 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 07:16:53.690531 16115 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45528
I20260811 07:16:53.690873 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 16212
I20260811 07:16:53.703126 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 16438
I20260811 07:16:53.711953 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 16671
I20260811 07:16:53.733392 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 16061
2026-08-11T07:16:53Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2223 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16905](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16905](info): set up 2 sockets
Aug 11 07:16:53 dist-test-slave-7f01 krb5kdc[16905](info): commencing operation
krb5kdc: starting...
W20260811 07:16:55.092319 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:55 dist-test-slave-7f01 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:16:55.227429 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:34615
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:34901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:34615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:55.315510 16923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:55.315716 16923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:55.315758 16923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:55.316905 16923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:55.316947 16923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:55.316962 16923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:55.316974 16923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:55.316987 16923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:55.318483 16923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:34615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:34615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:55.318742 16923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:55.318981 16923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:55.323861 16937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:55.323890 16935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:55.323897 16933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:55.324069 16923 server_base.cc:1034] running on GCE node
I20260811 07:16:55.324343 16923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:55.324669 16923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:55.325845 16923 hybrid_clock.cc:648] HybridClock initialized: now 1786432615325843 us; error 42 us; skew 500 ppm
Aug 11 07:16:55 dist-test-slave-7f01 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432615, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:55.332806 16923 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:16:55.333231 16923 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:55.333305 16923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:55.333572 16923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:55.334708 16923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "f6b79b8418be4369adf8b2a206447cd0"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "a4ac7ec187425e56c9fa3ff22bf2ce52"
server_key_iv: "2ce21be7736e3f146552b73013766eea"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.335086 16923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "f6b79b8418be4369adf8b2a206447cd0"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "a4ac7ec187425e56c9fa3ff22bf2ce52"
server_key_iv: "2ce21be7736e3f146552b73013766eea"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.336576 16923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:16:55.337337 16947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.337553 16923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:55.337662 16923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "f6b79b8418be4369adf8b2a206447cd0"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "a4ac7ec187425e56c9fa3ff22bf2ce52"
server_key_iv: "2ce21be7736e3f146552b73013766eea"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.337749 16923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:55.353705 16923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:55.356091 16923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:55.356254 16923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:55.360467 16923 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:34615
I20260811 07:16:55.360512 17024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:34615 every 8 connection(s)
I20260811 07:16:55.360824 16923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:55.361912 17026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:55.364379 17026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0: Bootstrap starting.
I20260811 07:16:55.364610 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 16923
I20260811 07:16:55.364723 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:55.364935 9786 external_mini_cluster.cc:1428] Setting key 8e8654ebad68747ce3d015d801d8e478
I20260811 07:16:55.365218 17026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:55.365605 17026 log.cc:824] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:55.366397 17026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0: No bootstrap required, opened a new log
I20260811 07:16:55.368340 17026 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6b79b8418be4369adf8b2a206447cd0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 34615 } }
I20260811 07:16:55.368497 17026 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:55.368549 17026 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6b79b8418be4369adf8b2a206447cd0, State: Initialized, Role: FOLLOWER
I20260811 07:16:55.368706 17026 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6b79b8418be4369adf8b2a206447cd0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 34615 } }
I20260811 07:16:55.368811 17026 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:55.368857 17026 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:55.368908 17026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:55.369444 17026 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6b79b8418be4369adf8b2a206447cd0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 34615 } }
I20260811 07:16:55.369572 17026 leader_election.cc:302] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6b79b8418be4369adf8b2a206447cd0; no voters:
I20260811 07:16:55.369737 17026 leader_election.cc:288] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:55.369787 17034 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:55.370018 17026 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:55.370223 17034 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [term 1 LEADER]: Becoming Leader. State: Replica: f6b79b8418be4369adf8b2a206447cd0, State: Running, Role: LEADER
I20260811 07:16:55.370325 17034 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6b79b8418be4369adf8b2a206447cd0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 34615 } }
I20260811 07:16:55.370675 17036 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6b79b8418be4369adf8b2a206447cd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6b79b8418be4369adf8b2a206447cd0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 34615 } } }
I20260811 07:16:55.370751 17036 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:55.370929 17040 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6b79b8418be4369adf8b2a206447cd0. Latest consensus state: current_term: 1 leader_uuid: "f6b79b8418be4369adf8b2a206447cd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6b79b8418be4369adf8b2a206447cd0" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 34615 } } }
I20260811 07:16:55.370991 17040 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:55.371347 17051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:55.371871 17051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 07:16:55 dist-test-slave-7f01 krb5kdc[16905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:55.373407 17051 catalog_manager.cc:1347] Generated new cluster ID: eec8f8ea05fa4c89a922a60527da2e3b
I20260811 07:16:55.373462 17051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:16:55.376013 17032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.365425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34504 (local address 127.9.142.190:34615)
0811 07:16:55.365616 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.365625 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.365680 (+ 55us) server_negotiation.cc:407] Connection header received
0811 07:16:55.366297 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.366306 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.366361 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.366519 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:55.367175 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.368118 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.369138 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.369543 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.369672 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.372451 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:55.372456 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:55.372456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:55.372470 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:55.374334 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.374736 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.374741 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.374745 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.374831 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.375056 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.375057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.375057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.375293 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:55.375468 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.375567 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.375706 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260811 07:16:55.388273 17051 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:55.388784 17051 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:55.395437 17051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0: Generated new TSK 0
I20260811 07:16:55.395613 17051 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:16:55.431071 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:34615
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:34901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:55.533886 17071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:55.534103 17071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:55.534129 17071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:55.535293 17071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:55.535341 17071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:55.535369 17071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:16:55.537000 17071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:34615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:55.537261 17071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:55.537503 17071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:55.542672 17079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:55.542730 17081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:55.542727 17083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:55.542920 17071 server_base.cc:1034] running on GCE node
I20260811 07:16:55.543133 17071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:55.543339 17071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:55.544476 17071 hybrid_clock.cc:648] HybridClock initialized: now 1786432615544463 us; error 27 us; skew 500 ppm
Aug 11 07:16:55 dist-test-slave-7f01 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432615, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:55.547127 17071 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:16:55.547441 17071 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:55.547488 17071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:55.547580 17071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:55.548693 17071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "9e7c0e9b24d14b23af6985f3c2a51570"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "2ee5e6bdd22e2d7034bdae7fa8967439"
server_key_iv: "72f7766c699f4d85cbad6c236d424f75"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.549012 17071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "9e7c0e9b24d14b23af6985f3c2a51570"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "2ee5e6bdd22e2d7034bdae7fa8967439"
server_key_iv: "72f7766c699f4d85cbad6c236d424f75"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.550305 17071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:16:55.551110 17092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.551307 17071 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:55.551429 17071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "9e7c0e9b24d14b23af6985f3c2a51570"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "2ee5e6bdd22e2d7034bdae7fa8967439"
server_key_iv: "72f7766c699f4d85cbad6c236d424f75"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.551509 17071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:55.568864 17071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:55.571141 17071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:55.571309 17071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:55.571590 17071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:55.572021 17071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:55.572079 17071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.572125 17071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:55.572168 17071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.578239 17071 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:35297
I20260811 07:16:55.578284 17273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:35297 every 8 connection(s)
I20260811 07:16:55.578568 17071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
Aug 11 07:16:55 dist-test-slave-7f01 krb5kdc[16905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432615, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:55.587539 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 17071
I20260811 07:16:55.587684 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:16:55.587940 9786 external_mini_cluster.cc:1428] Setting key 04cfcc97f804075a1e97845582bc5e13
I20260811 07:16:55.588423 17032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.579327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:56303 (local address 127.9.142.190:34615)
0811 07:16:55.579391 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.579393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.579603 (+ 210us) server_negotiation.cc:407] Connection header received
0811 07:16:55.580145 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.580146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.580158 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.580226 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:55.581258 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.581781 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.582813 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.583015 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.583073 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.585469 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:55.585471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:55.585471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:55.585478 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:55.586747 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.587177 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.587178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.587178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.587234 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.587572 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.587572 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.587573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.587790 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:55.587880 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.588230 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.588321 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 07:16:55.588647 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.579274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:34615 (local address 127.9.142.129:56303)
0811 07:16:55.579466 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:55.579512 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:55.580032 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:55.580310 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:55.580314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:55.580614 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:55.581170 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.581176 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.581883 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.581884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.582719 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.582721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.583130 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.583131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.583255 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.583907 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:55.583916 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:55.585377 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:55.586852 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:55.586859 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:55.586872 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:55.587105 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:55.587329 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:55.587330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:55.587331 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:55.587494 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:55.587878 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:55.587887 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:55.588066 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 07:16:55.588184 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 07:16:55.588391 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":97,"threads_started":1}
I20260811 07:16:55.589176 17276 heartbeater.cc:347] Connected to a master server at 127.9.142.190:34615
I20260811 07:16:55.589280 17276 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:55.589465 17276 heartbeater.cc:511] Master 127.9.142.190:34615 requested a full tablet report, sending...
I20260811 07:16:55.590077 16977 ts_manager.cc:194] Registered new tserver with Master: 9e7c0e9b24d14b23af6985f3c2a51570 (127.9.142.129:35297)
I20260811 07:16:55.590713 16977 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:56303
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:16:55.616339 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:34615
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:34901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:55.703608 17283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:55.703891 17283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:55.703922 17283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:55.705088 17283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:55.705130 17283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:55.705157 17283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:16:55.706712 17283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:34615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:55.706995 17283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:55.707245 17283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:55.712417 17293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:55.712437 17295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:55.712463 17297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:55.712678 17283 server_base.cc:1034] running on GCE node
I20260811 07:16:55.712893 17283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:55.713104 17283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:55.714248 17283 hybrid_clock.cc:648] HybridClock initialized: now 1786432615714230 us; error 31 us; skew 500 ppm
Aug 11 07:16:55 dist-test-slave-7f01 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432615, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:55.716938 17283 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:16:55.717319 17283 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:55.717397 17283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:55.717551 17283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:55.718669 17283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "ce0f55744f594153af72bb25b020c61a"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "7f95b03cf73e1a0c298cf829029d84b0"
server_key_iv: "acf85e7cd99d31a833678cc507e7b9c8"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.719054 17283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "ce0f55744f594153af72bb25b020c61a"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "7f95b03cf73e1a0c298cf829029d84b0"
server_key_iv: "acf85e7cd99d31a833678cc507e7b9c8"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.720548 17283 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 07:16:55.721381 17308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.721575 17283 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:55.721688 17283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "ce0f55744f594153af72bb25b020c61a"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "7f95b03cf73e1a0c298cf829029d84b0"
server_key_iv: "acf85e7cd99d31a833678cc507e7b9c8"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.721796 17283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:55.728832 17283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:55.730913 17283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:55.731079 17283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:55.731309 17283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:55.731626 17283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:55.731681 17283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.731722 17283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:55.731845 17283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.738304 17283 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:40685
I20260811 07:16:55.738349 17507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:40685 every 8 connection(s)
I20260811 07:16:55.738655 17283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:16:55.742492 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 17283
I20260811 07:16:55.742594 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:16:55.743016 9786 external_mini_cluster.cc:1428] Setting key 55bf9a16dd14302603a6d20328b7ae9a
Aug 11 07:16:55 dist-test-slave-7f01 krb5kdc[16905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432615, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:55.750129 17032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.739797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:46359 (local address 127.9.142.190:34615)
0811 07:16:55.739872 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.739874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.739947 (+ 73us) server_negotiation.cc:407] Connection header received
0811 07:16:55.740478 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.740479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.740494 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.740553 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:55.741621 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.742140 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.743374 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.743644 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.743770 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.746292 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:55.746293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:55.746293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:55.746301 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:55.748192 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.748808 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.748810 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.748810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.748873 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.749227 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.749228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.749229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.749360 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:55.749608 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.749964 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.750047 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":32}
I20260811 07:16:55.750574 17515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.739588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:34615 (local address 127.9.142.130:46359)
0811 07:16:55.739806 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:55.739850 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:55.740363 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:55.740666 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:55.740670 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:55.741008 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:55.741535 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.741541 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.742237 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.742238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.743245 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.743249 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.743816 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.743817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.743990 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.744629 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:55.744637 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:55.746186 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:55.748282 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:55.748290 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:55.748293 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:55.748697 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:55.749013 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:55.749014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:55.749015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:55.749144 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:55.749594 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:55.749603 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:55.749793 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 07:16:55.749929 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 07:16:55.750146 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":114,"threads_started":1}
I20260811 07:16:55.751111 17512 heartbeater.cc:347] Connected to a master server at 127.9.142.190:34615
I20260811 07:16:55.751240 17512 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:55.751432 17512 heartbeater.cc:511] Master 127.9.142.190:34615 requested a full tablet report, sending...
I20260811 07:16:55.751950 16977 ts_manager.cc:194] Registered new tserver with Master: ce0f55744f594153af72bb25b020c61a (127.9.142.130:40685)
I20260811 07:16:55.752521 16977 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:46359
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:16:55.774385 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:34615
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:34901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:16:55.860324 17519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:55.860574 17519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:55.860618 17519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:55.862038 17519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:55.862205 17519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:55.862371 17519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:16:55.864948 17519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:34615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:55.865271 17519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:55.865778 17519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:55.871796 17533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:55.871800 17530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:55.871850 17538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:55.872385 17519 server_base.cc:1034] running on GCE node
I20260811 07:16:55.872643 17519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:55.872931 17519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:55.874148 17519 hybrid_clock.cc:648] HybridClock initialized: now 1786432615874132 us; error 29 us; skew 500 ppm
Aug 11 07:16:55 dist-test-slave-7f01 krb5kdc[16905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432615, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:16:55.877594 17519 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:16:55.878087 17519 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:55.878181 17519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:55.878360 17519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:55.880061 17519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "ea695cbe4612404e9b8f90762cc63f2d"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "bab2f9c04a2d548b5a72365bb485f6eb"
server_key_iv: "0964353a1787e0055b5e738bac8be8c0"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.880535 17519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "ea695cbe4612404e9b8f90762cc63f2d"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "bab2f9c04a2d548b5a72365bb485f6eb"
server_key_iv: "0964353a1787e0055b5e738bac8be8c0"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.882212 17519 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:16:55.883194 17549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.883458 17519 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:55.883555 17519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "ea695cbe4612404e9b8f90762cc63f2d"
format_stamp: "Formatted at 2026-08-11 07:16:55 on dist-test-slave-7f01"
server_key: "bab2f9c04a2d548b5a72365bb485f6eb"
server_key_iv: "0964353a1787e0055b5e738bac8be8c0"
server_key_version: "encryptionkey@0"
I20260811 07:16:55.883626 17519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:55.894312 17519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:55.896879 17519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:55.897119 17519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:55.897477 17519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:55.897868 17519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:55.897954 17519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.898000 17519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:55.898029 17519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:55.904798 17519 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:38393
I20260811 07:16:55.904903 17715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:38393 every 8 connection(s)
I20260811 07:16:55.905169 17519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:16:55.911113 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 17519
I20260811 07:16:55.911214 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:16:55.911445 9786 external_mini_cluster.cc:1428] Setting key 9098d3ea60077ea170581c719eafdcc1
Aug 11 07:16:55 dist-test-slave-7f01 krb5kdc[16905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432615, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:16:55.916091 17032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.905990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:46333 (local address 127.9.142.190:34615)
0811 07:16:55.906044 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.906046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.906255 (+ 209us) server_negotiation.cc:407] Connection header received
0811 07:16:55.906754 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.906755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.906779 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.906836 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:55.907863 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.908627 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.910518 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.910896 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.910986 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.913407 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:55.913408 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:55.913409 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:55.913416 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:55.914615 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.915019 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.915020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.915020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.915075 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.915341 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.915343 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.915343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.915506 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:55.915575 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.915950 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.916024 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:16:55.916340 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.905920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:34615 (local address 127.9.142.131:46333)
0811 07:16:55.906116 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:55.906164 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:55.906650 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:55.906889 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:55.906893 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:55.907170 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:55.907683 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.907688 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.908925 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.908926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.910406 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.910410 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.911073 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.911074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.911250 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.911893 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:16:55.911902 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:55.913294 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:55.914697 (+ 1403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:55.914705 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:55.914708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:55.914941 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:55.915137 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:16:55.915138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:16:55.915138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:16:55.915241 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:16:55.915600 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:55.915608 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:55.915792 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 07:16:55.915929 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 07:16:55.916068 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":75,"threads_started":1}
I20260811 07:16:55.916997 17717 heartbeater.cc:347] Connected to a master server at 127.9.142.190:34615
I20260811 07:16:55.917138 17717 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:55.917357 17717 heartbeater.cc:511] Master 127.9.142.190:34615 requested a full tablet report, sending...
I20260811 07:16:55.917832 16977 ts_manager.cc:194] Registered new tserver with Master: ea695cbe4612404e9b8f90762cc63f2d (127.9.142.131:38393)
I20260811 07:16:55.918188 16977 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:46333
I20260811 07:16:55.923313 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:16:55.932648 17032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.924887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34516 (local address 127.9.142.190:34615)
0811 07:16:55.924949 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.924951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.925076 (+ 125us) server_negotiation.cc:407] Connection header received
0811 07:16:55.925132 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.925133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.925142 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.925186 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:55.925912 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.926469 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.927262 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.927804 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.927936 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.929607 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:55.929609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:55.929609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:16:55.929617 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:55.931201 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.931607 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.931608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.931608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.931667 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:16:55.932029 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:16:55.932030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:16:55.932030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:16:55.932202 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:55.932298 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.932496 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.932574 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 07:16:55.934566 16977 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34516:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:16:55.936287 16977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:55.944177 17743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.939265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:40685 (local address 127.0.0.1:45322)
0811 07:16:55.939804 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:55.939818 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:55.939882 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:55.940213 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:55.940214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:55.940216 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:55.940298 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.940300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.941385 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.941385 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.942854 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.942858 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.943788 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.943790 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.943903 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.943929 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 07:16:55.944025 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:16:55.944093 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"mutex_wait_us":3,"thread_start_us":117,"threads_started":1}
I20260811 07:16:55.944190 17744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.939569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45322 (local address 127.9.142.130:40685)
0811 07:16:55.939900 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.939905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.939916 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:16:55.939956 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.939958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.939972 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.940077 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:55.940383 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.941259 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.942969 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.943661 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.943788 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.943862 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.944045 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.944093 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":109,"threads_started":1}
I20260811 07:16:55.944424 17739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.939234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:38393 (local address 127.0.0.1:39502)
0811 07:16:55.939348 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:55.939486 (+ 138us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:55.939822 (+ 336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:55.940188 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:55.940192 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:55.940194 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:55.940383 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.940386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.941917 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.941918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.943113 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.943115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.944169 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.944170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.944240 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.944245 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:16:55.944298 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 07:16:55.944353 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":95,"thread_start_us":64,"threads_started":1}
I20260811 07:16:55.944705 17752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.939589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39502 (local address 127.9.142.131:38393)
0811 07:16:55.939850 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.939856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.939869 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:16:55.939937 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.939940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.939960 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.940053 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:55.940526 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.941803 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.943203 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.943995 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.944074 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.944129 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.944582 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.944626 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":130,"threads_started":1}
I20260811 07:16:55.945134 17392 tablet_service.cc:1467] Processing CreateTablet for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf (DEFAULT_TABLE table=test-table [id=bc9c523b724a455385bad27d3b805192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:55.945355 17621 tablet_service.cc:1467] Processing CreateTablet for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf (DEFAULT_TABLE table=test-table [id=bc9c523b724a455385bad27d3b805192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:55.945574 17392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:55.945659 17621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:55.948071 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.939568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35204 (local address 127.9.142.129:35297)
0811 07:16:55.939806 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.939812 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.940124 (+ 312us) server_negotiation.cc:407] Connection header received
0811 07:16:55.940415 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.940418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.940437 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.940518 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:55.940746 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.941994 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.943301 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.944022 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.944083 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.944129 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.947915 (+ 3786us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.947973 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":106,"threads_started":1}
I20260811 07:16:55.948352 17740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.939265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:35297 (local address 127.0.0.1:35204)
0811 07:16:55.940011 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:55.940022 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:55.940242 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:55.940613 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:55.940614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:55.940615 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:55.940652 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.940654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.942140 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.942141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.943155 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.943158 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.944172 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.944173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.947791 (+ 3618us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.947800 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 07:16:55.948224 (+ 424us) client_negotiation.cc:240] Negotiation successful
0811 07:16:55.948277 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"mutex_wait_us":6,"thread_start_us":112,"threads_started":1}
I20260811 07:16:55.949287 17753 tablet_bootstrap.cc:492] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: Bootstrap starting.
I20260811 07:16:55.949287 17755 tablet_bootstrap.cc:492] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: Bootstrap starting.
I20260811 07:16:55.949479 17172 tablet_service.cc:1467] Processing CreateTablet for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf (DEFAULT_TABLE table=test-table [id=bc9c523b724a455385bad27d3b805192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:55.949812 17172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:55.950040 17753 tablet_bootstrap.cc:654] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:55.950040 17755 tablet_bootstrap.cc:654] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:55.950731 17755 log.cc:824] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:55.950731 17753 log.cc:824] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:55.951674 17755 tablet_bootstrap.cc:492] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: No bootstrap required, opened a new log
I20260811 07:16:55.951730 17755 ts_tablet_manager.cc:1397] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:16:55.951856 17753 tablet_bootstrap.cc:492] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: No bootstrap required, opened a new log
I20260811 07:16:55.951931 17753 ts_tablet_manager.cc:1397] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:16:55.953122 17760 tablet_bootstrap.cc:492] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570: Bootstrap starting.
I20260811 07:16:55.954250 17753 raft_consensus.cc:348] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } }
I20260811 07:16:55.954396 17760 tablet_bootstrap.cc:654] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:55.954421 17753 raft_consensus.cc:374] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:55.954468 17753 raft_consensus.cc:729] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea695cbe4612404e9b8f90762cc63f2d, State: Initialized, Role: FOLLOWER
I20260811 07:16:55.954588 17753 consensus_queue.cc:260] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } }
I20260811 07:16:55.954919 17717 heartbeater.cc:503] Master 127.9.142.190:34615 was elected leader, sending a full tablet report...
I20260811 07:16:55.954923 17753 ts_tablet_manager.cc:1428] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:16:55.954931 17755 raft_consensus.cc:348] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } }
I20260811 07:16:55.955071 17760 log.cc:824] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:55.955096 17755 raft_consensus.cc:374] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:55.955132 17755 raft_consensus.cc:729] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce0f55744f594153af72bb25b020c61a, State: Initialized, Role: FOLLOWER
I20260811 07:16:55.955251 17755 consensus_queue.cc:260] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } }
I20260811 07:16:55.955791 17755 ts_tablet_manager.cc:1428] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 07:16:55.955981 17760 tablet_bootstrap.cc:492] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570: No bootstrap required, opened a new log
I20260811 07:16:55.956059 17760 ts_tablet_manager.cc:1397] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:16:55.956110 17512 heartbeater.cc:503] Master 127.9.142.190:34615 was elected leader, sending a full tablet report...
I20260811 07:16:55.958184 17760 raft_consensus.cc:348] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } }
I20260811 07:16:55.958367 17760 raft_consensus.cc:374] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:55.958395 17760 raft_consensus.cc:729] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7c0e9b24d14b23af6985f3c2a51570, State: Initialized, Role: FOLLOWER
I20260811 07:16:55.958500 17760 consensus_queue.cc:260] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } }
I20260811 07:16:55.958748 17760 ts_tablet_manager.cc:1428] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:16:55.958796 17276 heartbeater.cc:503] Master 127.9.142.190:34615 was elected leader, sending a full tablet report...
I20260811 07:16:55.962626 17764 raft_consensus.cc:482] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:55.962723 17764 raft_consensus.cc:504] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } }
I20260811 07:16:55.963023 17764 leader_election.cc:288] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea695cbe4612404e9b8f90762cc63f2d (127.9.142.131:38393), 9e7c0e9b24d14b23af6985f3c2a51570 (127.9.142.129:35297)
I20260811 07:16:55.967626 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.963616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:52657 (local address 127.9.142.129:35297)
0811 07:16:55.963713 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.963715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.963727 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:16:55.963773 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.963775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.963787 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.963850 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:55.964155 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.964914 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.966589 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.967202 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.967283 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.967292 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.967486 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.967540 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:16:55.967648 17515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.963213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:35297 (local address 127.9.142.130:52657)
0811 07:16:55.963275 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:55.963290 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:55.963342 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:55.963931 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:55.963932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:55.963934 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:55.964032 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.964034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.965043 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.965044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.966469 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.966473 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.967332 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.967333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.967420 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.967422 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:16:55.967479 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 07:16:55.967544 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":78}
I20260811 07:16:55.967653 17766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.963214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:38393 (local address 127.9.142.130:39781)
0811 07:16:55.963764 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:55.963775 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:55.963844 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:55.963976 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:55.963977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:55.963979 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:16:55.964045 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.964046 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.965043 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.965044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.966469 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:55.966473 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.967349 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.967350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:55.967417 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.967421 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:16:55.967480 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 07:16:55.967544 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":215,"thread_start_us":306,"threads_started":1}
I20260811 07:16:55.967937 17752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.963290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:39781 (local address 127.9.142.131:38393)
0811 07:16:55.963360 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.963362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.963843 (+ 481us) server_negotiation.cc:407] Connection header received
0811 07:16:55.963906 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.963907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.963915 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.963962 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:16:55.964155 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.964914 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.966589 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.967211 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.967283 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.967292 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.967775 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.967838 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:16:55.968115 17198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a9f89b2ccc048ffbb0c58218f6ceebf" candidate_uuid: "ce0f55744f594153af72bb25b020c61a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" is_pre_election: true
I20260811 07:16:55.968222 17652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a9f89b2ccc048ffbb0c58218f6ceebf" candidate_uuid: "ce0f55744f594153af72bb25b020c61a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea695cbe4612404e9b8f90762cc63f2d" is_pre_election: true
I20260811 07:16:55.968297 17198 raft_consensus.cc:2454] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce0f55744f594153af72bb25b020c61a in term 0.
I20260811 07:16:55.968374 17652 raft_consensus.cc:2454] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce0f55744f594153af72bb25b020c61a in term 0.
I20260811 07:16:55.968554 17313 leader_election.cc:302] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce0f55744f594153af72bb25b020c61a, ea695cbe4612404e9b8f90762cc63f2d; no voters:
I20260811 07:16:55.968742 17764 raft_consensus.cc:2781] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:55.968784 17764 raft_consensus.cc:482] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:55.968801 17764 raft_consensus.cc:3037] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:55.969560 17764 raft_consensus.cc:504] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } }
I20260811 07:16:55.969741 17764 leader_election.cc:288] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [CANDIDATE]: Term 1 election: Requested vote from peers ea695cbe4612404e9b8f90762cc63f2d (127.9.142.131:38393), 9e7c0e9b24d14b23af6985f3c2a51570 (127.9.142.129:35297)
I20260811 07:16:55.969880 17652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a9f89b2ccc048ffbb0c58218f6ceebf" candidate_uuid: "ce0f55744f594153af72bb25b020c61a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea695cbe4612404e9b8f90762cc63f2d"
I20260811 07:16:55.969916 17198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a9f89b2ccc048ffbb0c58218f6ceebf" candidate_uuid: "ce0f55744f594153af72bb25b020c61a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7c0e9b24d14b23af6985f3c2a51570"
I20260811 07:16:55.970003 17198 raft_consensus.cc:3037] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:55.969985 17652 raft_consensus.cc:3037] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:55.970954 17198 raft_consensus.cc:2454] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce0f55744f594153af72bb25b020c61a in term 1.
I20260811 07:16:55.971069 17652 raft_consensus.cc:2454] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce0f55744f594153af72bb25b020c61a in term 1.
I20260811 07:16:55.971174 17311 leader_election.cc:302] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7c0e9b24d14b23af6985f3c2a51570, ce0f55744f594153af72bb25b020c61a; no voters:
I20260811 07:16:55.971315 17764 raft_consensus.cc:2781] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:55.971535 17764 raft_consensus.cc:686] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 1 LEADER]: Becoming Leader. State: Replica: ce0f55744f594153af72bb25b020c61a, State: Running, Role: LEADER
I20260811 07:16:55.971678 17764 consensus_queue.cc:237] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } }
I20260811 07:16:55.972795 16977 catalog_manager.cc:5495] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a reported cstate change: term changed from 0 to 1, leader changed from <none> to ce0f55744f594153af72bb25b020c61a (127.9.142.130). New cstate: current_term: 1 leader_uuid: "ce0f55744f594153af72bb25b020c61a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0f55744f594153af72bb25b020c61a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 } health_report { overall_health: UNKNOWN } } }
I20260811 07:16:55.980218 17744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:55.977645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45334 (local address 127.9.142.130:40685)
0811 07:16:55.977697 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:55.977699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:55.977713 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:16:55.977800 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:55.977801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:55.977822 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:55.977915 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:16:55.978058 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.978539 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.979329 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:55.979538 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:55.979619 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:55.979839 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:16:55.979959 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:16:55.980051 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:55.980091 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 07:16:55.980113 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 07:16:55.982704 17198 raft_consensus.cc:1261] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [term 1 FOLLOWER]: Refusing update from remote peer ce0f55744f594153af72bb25b020c61a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:55.982704 17652 raft_consensus.cc:1261] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [term 1 FOLLOWER]: Refusing update from remote peer ce0f55744f594153af72bb25b020c61a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:55.983163 17768 consensus_queue.cc:1035] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7c0e9b24d14b23af6985f3c2a51570" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:55.983328 17764 consensus_queue.cc:1035] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea695cbe4612404e9b8f90762cc63f2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:55.986198 17777 mvcc.cc:205] Tried to move back new op lower bound from 7317227995059937280 to 7317227995021164544. Current Snapshot: MvccSnapshot[applied={T|T < 7317227995059937280}]
I20260811 07:16:55.987247 17778 mvcc.cc:205] Tried to move back new op lower bound from 7317227995059937280 to 7317227995021164544. Current Snapshot: MvccSnapshot[applied={T|T < 7317227995059937280}]
I20260811 07:16:55.989073 16977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:55.989183 16977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:55.990031 16977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f6b79b8418be4369adf8b2a206447cd0: Sending DeleteTablet for 3 replicas of tablet 1a9f89b2ccc048ffbb0c58218f6ceebf
I20260811 07:16:55.990513 17172 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:55 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:35204
I20260811 07:16:55.990658 17392 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:55 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:45322
I20260811 07:16:55.990878 17791 tablet_replica.cc:330] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570: stopping tablet replica
I20260811 07:16:55.990900 17792 tablet_replica.cc:330] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: stopping tablet replica
I20260811 07:16:55.990854 17621 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:55 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:39502
I20260811 07:16:55.990991 17792 raft_consensus.cc:2229] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:16:55.991129 17792 raft_consensus.cc:2258] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:55.991127 17791 raft_consensus.cc:2229] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:55.991273 17793 tablet_replica.cc:330] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: stopping tablet replica
I20260811 07:16:55.991379 17793 raft_consensus.cc:2229] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:55.991457 17791 raft_consensus.cc:2258] T 1a9f89b2ccc048ffbb0c58218f6ceebf P 9e7c0e9b24d14b23af6985f3c2a51570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:55.991487 17793 raft_consensus.cc:2258] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:55.991588 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 17071
I20260811 07:16:55.991988 17793 ts_tablet_manager.cc:1905] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:55.994742 17793 ts_tablet_manager.cc:1918] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:16:55.994830 17793 log.cc:1196] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/1a9f89b2ccc048ffbb0c58218f6ceebf
I20260811 07:16:55.995151 17793 ts_tablet_manager.cc:1939] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ea695cbe4612404e9b8f90762cc63f2d: Deleting consensus metadata
I20260811 07:16:55.997231 16954 catalog_manager.cc:4841] TS ea695cbe4612404e9b8f90762cc63f2d (127.9.142.131:38393): tablet 1a9f89b2ccc048ffbb0c58218f6ceebf (table test-table [id=bc9c523b724a455385bad27d3b805192]) successfully deleted
I20260811 07:16:55.999605 17792 ts_tablet_manager.cc:1905] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:56.001791 17792 ts_tablet_manager.cc:1918] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:16:56.001889 17792 log.cc:1196] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/1a9f89b2ccc048ffbb0c58218f6ceebf
I20260811 07:16:56.002200 17792 ts_tablet_manager.cc:1939] T 1a9f89b2ccc048ffbb0c58218f6ceebf P ce0f55744f594153af72bb25b020c61a: Deleting consensus metadata
I20260811 07:16:56.002741 16950 catalog_manager.cc:4841] TS ce0f55744f594153af72bb25b020c61a (127.9.142.130:40685): tablet 1a9f89b2ccc048ffbb0c58218f6ceebf (table test-table [id=bc9c523b724a455385bad27d3b805192]) successfully deleted
W20260811 07:16:56.005218 16949 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:35297 (error 108)
I20260811 07:16:56.005931 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 17283
I20260811 07:16:56.005980 17740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.005837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:35297 (local address 127.0.0.1:35210)
0811 07:16:56.005890 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.005940 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:35297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 07:16:56.014817 16949 catalog_manager.cc:4584] TS 9e7c0e9b24d14b23af6985f3c2a51570 (127.9.142.129:35297): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1a9f89b2ccc048ffbb0c58218f6ceebf: Network error: Client connection negotiation failed: client connection to 127.9.142.129:35297: connect: Connection refused (error 111)
I20260811 07:16:56.029014 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 17519
I20260811 07:16:56.040565 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 16923
2026-08-11T07:16:56Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2307 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T07:16:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:56Z Disabled control of system clock
I20260811 07:16:56.075731 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:40635
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:43267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:40635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:16:56.162024 17800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:56.162235 17800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:56.162257 17800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:56.163635 17800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:56.163681 17800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:56.163694 17800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:56.163707 17800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:56.163719 17800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:16:56.165230 17800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:43267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:40635
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:40635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:56.165483 17800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:56.165798 17800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:56.170660 17811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:56.170771 17814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:56.170672 17809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:56.170923 17800 server_base.cc:1034] running on GCE node
I20260811 07:16:56.171173 17800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:56.171458 17800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:56.172619 17800 hybrid_clock.cc:648] HybridClock initialized: now 1786432616172604 us; error 28 us; skew 500 ppm
I20260811 07:16:56.173820 17800 webserver.cc:460] Webserver started at http://127.9.142.190:37307/ using document root <none> and password file <none>
I20260811 07:16:56.174089 17800 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:56.174137 17800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:56.174288 17800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:56.175320 17800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "2a16978b1fc64363a7f2635a602d5a36"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "645354d21fefdbd605f20217032a533b"
server_key_iv: "623345b122e06e4a36c32e2594e37d59"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.175678 17800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "2a16978b1fc64363a7f2635a602d5a36"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "645354d21fefdbd605f20217032a533b"
server_key_iv: "623345b122e06e4a36c32e2594e37d59"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.177017 17800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:56.177799 17824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.177978 17800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:56.178097 17800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "2a16978b1fc64363a7f2635a602d5a36"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "645354d21fefdbd605f20217032a533b"
server_key_iv: "623345b122e06e4a36c32e2594e37d59"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.178179 17800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:56.181569 17800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:56.181818 17800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:56.181963 17800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:56.186100 17800 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:40635
I20260811 07:16:56.186134 17898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:40635 every 8 connection(s)
I20260811 07:16:56.186456 17800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:56.187139 17900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:56.189927 17900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36: Bootstrap starting.
I20260811 07:16:56.190240 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 17800
I20260811 07:16:56.190361 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:56.190536 17900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:56.190559 9786 external_mini_cluster.cc:1428] Setting key 4e797ef835c5f1fc2fd8283d29007911
I20260811 07:16:56.190886 17900 log.cc:824] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:56.191640 17900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36: No bootstrap required, opened a new log
I20260811 07:16:56.193168 17904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.191064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55946 (local address 127.9.142.190:40635)
0811 07:16:56.191295 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.191304 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.191338 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:16:56.191894 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.191902 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.191948 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.192099 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.192729 (+ 630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.192733 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.192734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.192739 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.192785 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.192799 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.192893 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.192925 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.192979 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20260811 07:16:56.193552 17900 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a16978b1fc64363a7f2635a602d5a36" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40635 } }
I20260811 07:16:56.193708 17900 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:56.193753 17900 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a16978b1fc64363a7f2635a602d5a36, State: Initialized, Role: FOLLOWER
I20260811 07:16:56.193908 17900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a16978b1fc64363a7f2635a602d5a36" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40635 } }
I20260811 07:16:56.194018 17900 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:56.194067 17900 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:56.194116 17900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:56.194900 17900 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a16978b1fc64363a7f2635a602d5a36" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40635 } }
I20260811 07:16:56.195029 17900 leader_election.cc:302] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a16978b1fc64363a7f2635a602d5a36; no voters:
I20260811 07:16:56.195204 17900 leader_election.cc:288] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:56.195236 17906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:56.195403 17906 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [term 1 LEADER]: Becoming Leader. State: Replica: 2a16978b1fc64363a7f2635a602d5a36, State: Running, Role: LEADER
I20260811 07:16:56.195461 17900 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:56.195546 17906 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a16978b1fc64363a7f2635a602d5a36" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40635 } }
I20260811 07:16:56.195966 17908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a16978b1fc64363a7f2635a602d5a36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a16978b1fc64363a7f2635a602d5a36" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40635 } } }
I20260811 07:16:56.196097 17908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:56.195966 17909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a16978b1fc64363a7f2635a602d5a36. Latest consensus state: current_term: 1 leader_uuid: "2a16978b1fc64363a7f2635a602d5a36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a16978b1fc64363a7f2635a602d5a36" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40635 } } }
I20260811 07:16:56.196174 17909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36 [sys.catalog]: This master's current role is: LEADER
W20260811 07:16:56.197477 17932 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:16:56.197547 17932 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:16:56.197597 17916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:56.197750 17916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:56.199167 17916 catalog_manager.cc:1347] Generated new cluster ID: 52744078e1584714910a0b43e968b2fa
I20260811 07:16:56.199229 17916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:16:56.206851 17916 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:56.207001 17916 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:56.223138 17916 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36: Generated new TSK 0
I20260811 07:16:56.223320 17916 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:16:56.226644 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40635
--builtin_ntp_servers=127.9.142.148:43267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:16:56.311197 17937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:56.311437 17937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:56.311474 17937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:56.312685 17937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:56.312747 17937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:56.312790 17937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:16:56.314127 17937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:43267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:56.314383 17937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:56.314666 17937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:56.319885 17947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:56.319914 17950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:56.319918 17948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:56.320178 17937 server_base.cc:1034] running on GCE node
I20260811 07:16:56.320441 17937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:56.320703 17937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:56.321863 17937 hybrid_clock.cc:648] HybridClock initialized: now 1786432616321851 us; error 27 us; skew 500 ppm
I20260811 07:16:56.323283 17937 webserver.cc:460] Webserver started at http://127.9.142.129:33131/ using document root <none> and password file <none>
I20260811 07:16:56.323540 17937 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:56.323599 17937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:56.323719 17937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:56.325173 17937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "66872cf97caea1918079d5d56609ae39"
server_key_iv: "f39ddbd8fa92a611f559dc6078da309b"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.325644 17937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "66872cf97caea1918079d5d56609ae39"
server_key_iv: "f39ddbd8fa92a611f559dc6078da309b"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.327355 17937 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:16:56.328235 17958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.328441 17937 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:16:56.328547 17937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "66872cf97caea1918079d5d56609ae39"
server_key_iv: "f39ddbd8fa92a611f559dc6078da309b"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.328619 17937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:56.332247 17937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:56.332476 17937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:56.332577 17937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:56.332736 17937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:56.332978 17937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:56.333017 17937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.333038 17937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:56.333051 17937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.338836 17937 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:46605
I20260811 07:16:56.338919 18138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:46605 every 8 connection(s)
I20260811 07:16:56.339237 17937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:16:56.342193 17904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.340030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:46357 (local address 127.9.142.190:40635)
0811 07:16:56.340097 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.340100 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.340348 (+ 248us) server_negotiation.cc:407] Connection header received
0811 07:16:56.340794 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.340795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.340800 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.340852 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.341950 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.341952 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.341952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.341956 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.341970 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.341974 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.342022 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.342108 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.342120 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:16:56.342386 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.340027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:40635 (local address 127.9.142.129:46357)
0811 07:16:56.340232 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.340265 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:56.340710 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:56.340901 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:56.340904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:56.340912 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:56.341786 (+ 874us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:16:56.341786 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:56.341813 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:16:56.341840 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:56.342037 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:56.342042 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:56.342044 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:16:56.342103 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 07:16:56.342151 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":107,"threads_started":1}
I20260811 07:16:56.342406 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 17937
I20260811 07:16:56.342518 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:16:56.342737 9786 external_mini_cluster.cc:1428] Setting key 4cad06d356848bbbaa53ffff4c238413
I20260811 07:16:56.342937 18139 heartbeater.cc:347] Connected to a master server at 127.9.142.190:40635
I20260811 07:16:56.343036 18139 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:56.343182 18139 heartbeater.cc:511] Master 127.9.142.190:40635 requested a full tablet report, sending...
I20260811 07:16:56.343686 17848 ts_manager.cc:194] Registered new tserver with Master: 416fd778ef7d4f91bbc8b2f3cd39d4ff (127.9.142.129:46605)
I20260811 07:16:56.343701 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40635
--builtin_ntp_servers=127.9.142.148:43267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:16:56.429435 18145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:56.429632 18145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:56.429654 18145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:56.430778 18145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:56.430815 18145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:56.430840 18145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:16:56.432417 18145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:43267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:56.432679 18145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:56.433022 18145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:56.438047 18158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:56.438027 18154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:56.438021 18155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:56.438333 18145 server_base.cc:1034] running on GCE node
I20260811 07:16:56.438527 18145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:56.438776 18145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:56.439937 18145 hybrid_clock.cc:648] HybridClock initialized: now 1786432616439926 us; error 45 us; skew 500 ppm
I20260811 07:16:56.441234 18145 webserver.cc:460] Webserver started at http://127.9.142.130:41993/ using document root <none> and password file <none>
I20260811 07:16:56.441534 18145 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:56.441606 18145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:56.441745 18145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:56.442759 18145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "ad60737706654871b58fc79b814ce008"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "a63735fa0b7245642a0e41632d26a7ff"
server_key_iv: "8d328fcf9bcc5bacd184a8d8483cf482"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.443125 18145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "ad60737706654871b58fc79b814ce008"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "a63735fa0b7245642a0e41632d26a7ff"
server_key_iv: "8d328fcf9bcc5bacd184a8d8483cf482"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.444530 18145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:16:56.445271 18169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.445447 18145 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:16:56.445555 18145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "ad60737706654871b58fc79b814ce008"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "a63735fa0b7245642a0e41632d26a7ff"
server_key_iv: "8d328fcf9bcc5bacd184a8d8483cf482"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.445631 18145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:56.448983 18145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:56.449245 18145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:56.449393 18145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:56.449620 18145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:56.449920 18145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:56.449973 18145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.450022 18145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:56.450049 18145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.456099 18145 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:45907
I20260811 07:16:56.456144 18363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:45907 every 8 connection(s)
I20260811 07:16:56.456449 18145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:16:56.459385 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 18145
I20260811 07:16:56.459414 17904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.457097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:56249 (local address 127.9.142.190:40635)
0811 07:16:56.457147 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.457149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.457404 (+ 255us) server_negotiation.cc:407] Connection header received
0811 07:16:56.457919 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.457921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.457929 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.457999 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.459130 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.459131 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.459132 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.459136 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.459151 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.459156 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.459235 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.459325 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.459341 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:16:56.459517 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:16:56.459663 18372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.457064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:40635 (local address 127.9.142.130:56249)
0811 07:16:56.457260 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.457302 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:56.457802 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:56.458071 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:56.458075 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:56.458084 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:56.458965 (+ 881us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:16:56.458966 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:56.459001 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:16:56.459027 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:56.459246 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:56.459253 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:56.459256 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:16:56.459325 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:16:56.459388 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":80,"threads_started":1}
I20260811 07:16:56.459715 9786 external_mini_cluster.cc:1428] Setting key 8c1d1fd021586f4e00246b49070c8dd5
I20260811 07:16:56.460230 18366 heartbeater.cc:347] Connected to a master server at 127.9.142.190:40635
I20260811 07:16:56.460319 18366 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:56.460466 18366 heartbeater.cc:511] Master 127.9.142.190:40635 requested a full tablet report, sending...
I20260811 07:16:56.460857 17847 ts_manager.cc:194] Registered new tserver with Master: ad60737706654871b58fc79b814ce008 (127.9.142.130:45907)
I20260811 07:16:56.460932 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40635
--builtin_ntp_servers=127.9.142.148:43267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:16:56.547477 18373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:56.547739 18373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:56.547807 18373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:56.549089 18373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:56.549160 18373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:56.549206 18373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:16:56.550582 18373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:43267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:56.550870 18373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:56.551184 18373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:56.556373 18381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:56.556526 18380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:56.556533 18373 server_base.cc:1034] running on GCE node
W20260811 07:16:56.556380 18383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:56.556875 18373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:56.557144 18373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:56.558334 18373 hybrid_clock.cc:648] HybridClock initialized: now 1786432616558322 us; error 29 us; skew 500 ppm
I20260811 07:16:56.559695 18373 webserver.cc:460] Webserver started at http://127.9.142.131:46279/ using document root <none> and password file <none>
I20260811 07:16:56.560006 18373 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:56.560084 18373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:56.560248 18373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:56.561393 18373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "f0d989ac8afc4967bd59f6876fc49042"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "0244545c666e124f794db5329b5f44e8"
server_key_iv: "cc72fb497b1e40b4885e4181bad71bb3"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.561777 18373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "f0d989ac8afc4967bd59f6876fc49042"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "0244545c666e124f794db5329b5f44e8"
server_key_iv: "cc72fb497b1e40b4885e4181bad71bb3"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.563161 18373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:16:56.563963 18391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.564142 18373 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:16:56.564256 18373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "f0d989ac8afc4967bd59f6876fc49042"
format_stamp: "Formatted at 2026-08-11 07:16:56 on dist-test-slave-7f01"
server_key: "0244545c666e124f794db5329b5f44e8"
server_key_iv: "cc72fb497b1e40b4885e4181bad71bb3"
server_key_version: "encryptionkey@0"
I20260811 07:16:56.564332 18373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:56.567873 18373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:56.568143 18373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:56.568293 18373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:56.568516 18373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:16:56.568835 18373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:16:56.568892 18373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.568933 18373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:16:56.568959 18373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:56.575086 18373 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:37353
I20260811 07:16:56.575138 18572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:37353 every 8 connection(s)
I20260811 07:16:56.575455 18373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:16:56.576572 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 18373
I20260811 07:16:56.576690 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:16:56.576889 9786 external_mini_cluster.cc:1428] Setting key 286e7e764c44386553679f18b1756ec2
I20260811 07:16:56.578823 17904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.576243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:36445 (local address 127.9.142.190:40635)
0811 07:16:56.576319 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.576338 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.576608 (+ 270us) server_negotiation.cc:407] Connection header received
0811 07:16:56.577322 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.577324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.577330 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.577386 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.578645 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.578646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.578647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.578650 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.578664 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.578668 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.578713 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.578758 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.578769 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:16:56.579015 18578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.576222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:40635 (local address 127.9.142.131:36445)
0811 07:16:56.576438 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.576493 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:56.577174 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:56.577471 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:56.577476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:56.577486 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:56.578499 (+ 1013us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:16:56.578499 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:56.578527 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:16:56.578555 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:56.578711 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:56.578713 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:56.578716 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:16:56.578765 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 07:16:56.578812 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260811 07:16:56.579437 18576 heartbeater.cc:347] Connected to a master server at 127.9.142.190:40635
I20260811 07:16:56.579517 18576 heartbeater.cc:464] Registering TS with master...
I20260811 07:16:56.579689 18576 heartbeater.cc:511] Master 127.9.142.190:40635 requested a full tablet report, sending...
I20260811 07:16:56.580060 17847 ts_manager.cc:194] Registered new tserver with Master: f0d989ac8afc4967bd59f6876fc49042 (127.9.142.131:37353)
I20260811 07:16:56.589004 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:16:56.591557 17904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.590448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55952 (local address 127.9.142.190:40635)
0811 07:16:56.590489 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.590491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.590650 (+ 159us) server_negotiation.cc:407] Connection header received
0811 07:16:56.590679 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.590680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.590685 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.590737 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.591257 (+ 520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.591258 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.591258 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.591262 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.591276 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.591280 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.591328 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.591362 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.591443 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:16:56.593151 17847 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:16:56.594682 17847 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:16:56.598810 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.597032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:46605 (local address 127.0.0.1:34490)
0811 07:16:56.597415 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.597424 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:56.597470 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:56.597690 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:56.597699 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:56.597706 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:56.598366 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:16:56.598367 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:56.598384 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:16:56.598409 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:56.598638 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:56.598643 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:56.598645 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:16:56.598714 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:16:56.598730 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":4,"spinlock_wait_cycles":768,"thread_start_us":98,"threads_started":1}
I20260811 07:16:56.598835 18596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.597230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34490 (local address 127.9.142.129:46605)
0811 07:16:56.597391 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.597396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.597468 (+ 72us) server_negotiation.cc:407] Connection header received
0811 07:16:56.597525 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.597528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.597537 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.597616 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.598483 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.598494 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.598495 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.598499 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.598541 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.598558 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.598644 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.598720 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.598737 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260811 07:16:56.599292 18591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.597032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:45907 (local address 127.0.0.1:55292)
0811 07:16:56.597219 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.597263 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:56.597322 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:56.598153 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:56.598154 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:56.598157 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:56.598999 (+ 842us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:16:56.598999 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:56.599004 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:16:56.599014 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:56.599220 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:56.599220 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:56.599221 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 07:16:56.599245 (+ 24us) client_negotiation.cc:240] Negotiation successful
0811 07:16:56.599254 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":74,"threads_started":1}
I20260811 07:16:56.599366 18601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.597428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55292 (local address 127.9.142.130:45907)
0811 07:16:56.597999 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.598004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.598014 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:16:56.598043 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.598045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.598053 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.598132 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.599084 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.599093 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.599093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.599097 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.599131 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.599152 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.599227 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.599255 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.599283 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":75,"threads_started":1}
I20260811 07:16:56.599817 18038 tablet_service.cc:1467] Processing CreateTablet for tablet 80c21f77dc234d0bab2ae481abbdace0 (DEFAULT_TABLE table=test-table [id=a2b51aa9bc214b4b925067075c43b312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:56.600211 18038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80c21f77dc234d0bab2ae481abbdace0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:56.602825 18602 tablet_bootstrap.cc:492] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff: Bootstrap starting.
I20260811 07:16:56.603300 18249 tablet_service.cc:1467] Processing CreateTablet for tablet 80c21f77dc234d0bab2ae481abbdace0 (DEFAULT_TABLE table=test-table [id=a2b51aa9bc214b4b925067075c43b312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:56.603550 18602 tablet_bootstrap.cc:654] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:56.603641 18249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80c21f77dc234d0bab2ae481abbdace0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:56.603960 18593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.597047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:37353 (local address 127.0.0.1:34266)
0811 07:16:56.597597 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.597607 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:56.597654 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:56.598131 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:56.598132 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:56.598135 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:56.598653 (+ 518us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:16:56.598654 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:56.598661 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:16:56.598673 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:56.603797 (+ 5124us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:56.603798 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:56.603799 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 07:16:56.603866 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 07:16:56.603882 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":111,"threads_started":1}
I20260811 07:16:56.603960 18602 log.cc:824] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:56.604012 18600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.597299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34266 (local address 127.9.142.131:37353)
0811 07:16:56.597516 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.597521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.597713 (+ 192us) server_negotiation.cc:407] Connection header received
0811 07:16:56.597742 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.597745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.597756 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.597856 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.598743 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.598751 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.598752 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.598756 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.598797 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.598822 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.598891 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.603895 (+ 5004us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.603915 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":103,"threads_started":1}
I20260811 07:16:56.604722 18475 tablet_service.cc:1467] Processing CreateTablet for tablet 80c21f77dc234d0bab2ae481abbdace0 (DEFAULT_TABLE table=test-table [id=a2b51aa9bc214b4b925067075c43b312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:16:56.605095 18475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80c21f77dc234d0bab2ae481abbdace0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:56.606534 18608 tablet_bootstrap.cc:492] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008: Bootstrap starting.
I20260811 07:16:56.607244 18608 tablet_bootstrap.cc:654] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:56.607618 18608 log.cc:824] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:56.608028 18613 tablet_bootstrap.cc:492] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: Bootstrap starting.
I20260811 07:16:56.608404 18608 tablet_bootstrap.cc:492] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008: No bootstrap required, opened a new log
I20260811 07:16:56.608404 18602 tablet_bootstrap.cc:492] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff: No bootstrap required, opened a new log
I20260811 07:16:56.608480 18602 ts_tablet_manager.cc:1397] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260811 07:16:56.608480 18608 ts_tablet_manager.cc:1397] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:16:56.611195 18602 raft_consensus.cc:348] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } }
I20260811 07:16:56.611195 18608 raft_consensus.cc:348] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } }
I20260811 07:16:56.611372 18608 raft_consensus.cc:374] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:56.611372 18602 raft_consensus.cc:374] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:56.611411 18602 raft_consensus.cc:729] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416fd778ef7d4f91bbc8b2f3cd39d4ff, State: Initialized, Role: FOLLOWER
I20260811 07:16:56.611411 18608 raft_consensus.cc:729] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad60737706654871b58fc79b814ce008, State: Initialized, Role: FOLLOWER
I20260811 07:16:56.611558 18608 consensus_queue.cc:260] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } }
I20260811 07:16:56.611559 18602 consensus_queue.cc:260] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } }
I20260811 07:16:56.611861 18608 ts_tablet_manager.cc:1428] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:16:56.611861 18602 ts_tablet_manager.cc:1428] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 07:16:56.611984 18366 heartbeater.cc:503] Master 127.9.142.190:40635 was elected leader, sending a full tablet report...
I20260811 07:16:56.612282 18139 heartbeater.cc:503] Master 127.9.142.190:40635 was elected leader, sending a full tablet report...
I20260811 07:16:56.612286 18613 tablet_bootstrap.cc:654] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:56.612637 18613 log.cc:824] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:56.613433 18613 tablet_bootstrap.cc:492] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: No bootstrap required, opened a new log
I20260811 07:16:56.613514 18613 ts_tablet_manager.cc:1397] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260811 07:16:56.615372 18613 raft_consensus.cc:348] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } }
I20260811 07:16:56.615499 18613 raft_consensus.cc:374] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:56.615521 18613 raft_consensus.cc:729] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d989ac8afc4967bd59f6876fc49042, State: Initialized, Role: FOLLOWER
I20260811 07:16:56.615661 18613 consensus_queue.cc:260] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } }
I20260811 07:16:56.616044 18576 heartbeater.cc:503] Master 127.9.142.190:40635 was elected leader, sending a full tablet report...
I20260811 07:16:56.615985 18613 ts_tablet_manager.cc:1428] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
W20260811 07:16:56.707027 18371 tablet.cc:2369] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:16:56.826086 18577 tablet.cc:2369] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:16:56.833683 18619 raft_consensus.cc:482] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:16:56.833847 18619 raft_consensus.cc:504] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } }
I20260811 07:16:56.834298 18619 leader_election.cc:288] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 416fd778ef7d4f91bbc8b2f3cd39d4ff (127.9.142.129:46605), ad60737706654871b58fc79b814ce008 (127.9.142.130:45907)
I20260811 07:16:56.835870 18601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.834705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:56783 (local address 127.9.142.130:45907)
0811 07:16:56.834759 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.834761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.834769 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:16:56.834830 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.834831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.834856 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.834908 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.835586 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.835587 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.835587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.835592 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.835611 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.835616 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.835676 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.835780 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.835795 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 07:16:56.835886 18596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.834567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:50045 (local address 127.9.142.129:46605)
0811 07:16:56.834622 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.834625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.834639 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:16:56.834728 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.834730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.834739 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.834801 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.835566 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.835567 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.835568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.835573 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.835594 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.835600 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.835669 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.835779 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.835796 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:16:56.835896 18578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.834514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:46605 (local address 127.9.142.131:50045)
0811 07:16:56.834564 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.834578 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:56.834629 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:56.834878 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:56.834879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:56.834881 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:56.835372 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:16:56.835372 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:56.835385 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:16:56.835437 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:56.835689 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:56.835690 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:56.835691 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 07:16:56.835773 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:16:56.835794 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 07:16:56.835908 18621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.834530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:45907 (local address 127.9.142.131:56783)
0811 07:16:56.834715 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.834726 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:56.834764 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:56.834930 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:56.834930 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:56.834947 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:16:56.835478 (+ 531us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:16:56.835478 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:16:56.835484 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:16:56.835496 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:16:56.835689 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:16:56.835690 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:16:56.835691 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 07:16:56.835774 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:16:56.835796 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":2,"thread_start_us":116,"threads_started":1}
I20260811 07:16:56.836356 18065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80c21f77dc234d0bab2ae481abbdace0" candidate_uuid: "f0d989ac8afc4967bd59f6876fc49042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" is_pre_election: true
I20260811 07:16:56.836411 18282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80c21f77dc234d0bab2ae481abbdace0" candidate_uuid: "f0d989ac8afc4967bd59f6876fc49042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad60737706654871b58fc79b814ce008" is_pre_election: true
I20260811 07:16:56.836566 18282 raft_consensus.cc:2454] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0d989ac8afc4967bd59f6876fc49042 in term 0.
I20260811 07:16:56.836566 18065 raft_consensus.cc:2454] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0d989ac8afc4967bd59f6876fc49042 in term 0.
I20260811 07:16:56.836859 18392 leader_election.cc:302] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad60737706654871b58fc79b814ce008, f0d989ac8afc4967bd59f6876fc49042; no voters:
I20260811 07:16:56.837025 18619 raft_consensus.cc:2781] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:16:56.837093 18619 raft_consensus.cc:482] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:16:56.837119 18619 raft_consensus.cc:3037] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:56.837908 18619 raft_consensus.cc:504] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } }
I20260811 07:16:56.838073 18619 leader_election.cc:288] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [CANDIDATE]: Term 1 election: Requested vote from peers 416fd778ef7d4f91bbc8b2f3cd39d4ff (127.9.142.129:46605), ad60737706654871b58fc79b814ce008 (127.9.142.130:45907)
I20260811 07:16:56.838249 18065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80c21f77dc234d0bab2ae481abbdace0" candidate_uuid: "f0d989ac8afc4967bd59f6876fc49042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff"
I20260811 07:16:56.838255 18282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80c21f77dc234d0bab2ae481abbdace0" candidate_uuid: "f0d989ac8afc4967bd59f6876fc49042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad60737706654871b58fc79b814ce008"
I20260811 07:16:56.838337 18065 raft_consensus.cc:3037] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:56.838370 18282 raft_consensus.cc:3037] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:56.839131 18065 raft_consensus.cc:2454] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0d989ac8afc4967bd59f6876fc49042 in term 1.
I20260811 07:16:56.839133 18282 raft_consensus.cc:2454] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0d989ac8afc4967bd59f6876fc49042 in term 1.
I20260811 07:16:56.839313 18392 leader_election.cc:302] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad60737706654871b58fc79b814ce008, f0d989ac8afc4967bd59f6876fc49042; no voters:
I20260811 07:16:56.839433 18619 raft_consensus.cc:2781] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:56.839596 18619 raft_consensus.cc:686] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 1 LEADER]: Becoming Leader. State: Replica: f0d989ac8afc4967bd59f6876fc49042, State: Running, Role: LEADER
I20260811 07:16:56.839699 18619 consensus_queue.cc:237] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } }
W20260811 07:16:56.839989 18142 tablet.cc:2369] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:16:56.840703 17848 catalog_manager.cc:5495] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0d989ac8afc4967bd59f6876fc49042 (127.9.142.131). New cstate: current_term: 1 leader_uuid: "f0d989ac8afc4967bd59f6876fc49042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0d989ac8afc4967bd59f6876fc49042" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37353 } health_report { overall_health: HEALTHY } } }
I20260811 07:16:56.886643 18600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.885387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34270 (local address 127.9.142.131:37353)
0811 07:16:56.885457 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:56.885459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:56.885470 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:16:56.885582 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:56.885583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:56.885606 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:56.885679 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:56.886348 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:56.886350 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:56.886350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:56.886355 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:56.886391 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:56.886396 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:56.886472 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:56.886530 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 07:16:56.886548 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 07:16:56.888841 18282 raft_consensus.cc:1261] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [term 1 FOLLOWER]: Refusing update from remote peer f0d989ac8afc4967bd59f6876fc49042: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:56.888829 18065 raft_consensus.cc:1261] T 80c21f77dc234d0bab2ae481abbdace0 P 416fd778ef7d4f91bbc8b2f3cd39d4ff [term 1 FOLLOWER]: Refusing update from remote peer f0d989ac8afc4967bd59f6876fc49042: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:16:56.889240 18622 consensus_queue.cc:1035] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad60737706654871b58fc79b814ce008" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 45907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:56.889396 18619 consensus_queue.cc:1035] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "416fd778ef7d4f91bbc8b2f3cd39d4ff" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 46605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:16:56.891707 18627 mvcc.cc:205] Tried to move back new op lower bound from 7317227998773297152 to 7317227998576390144. Current Snapshot: MvccSnapshot[applied={T|T < 7317227998773297152}]
I20260811 07:16:56.891993 18630 mvcc.cc:205] Tried to move back new op lower bound from 7317227998773297152 to 7317227998576390144. Current Snapshot: MvccSnapshot[applied={T|T < 7317227998773297152}]
I20260811 07:16:56.894410 17848 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:56.894522 17848 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:16:56.895254 17848 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a16978b1fc64363a7f2635a602d5a36: Sending DeleteTablet for 3 replicas of tablet 80c21f77dc234d0bab2ae481abbdace0
I20260811 07:16:56.895630 18475 tablet_service.cc:1514] Processing DeleteTablet for tablet 80c21f77dc234d0bab2ae481abbdace0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:56 UTC) from {username='slave'} at 127.0.0.1:34266
I20260811 07:16:56.895671 18038 tablet_service.cc:1514] Processing DeleteTablet for tablet 80c21f77dc234d0bab2ae481abbdace0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:56 UTC) from {username='slave'} at 127.0.0.1:34490
I20260811 07:16:56.895671 18249 tablet_service.cc:1514] Processing DeleteTablet for tablet 80c21f77dc234d0bab2ae481abbdace0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:16:56 UTC) from {username='slave'} at 127.0.0.1:55292
I20260811 07:16:56.896075 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 17937
I20260811 07:16:56.924506 18650 tablet_replica.cc:330] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008: stopping tablet replica
I20260811 07:16:56.924726 18650 raft_consensus.cc:2229] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:16:56.924889 18650 raft_consensus.cc:2258] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:56.925117 18648 tablet_replica.cc:330] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: stopping tablet replica
I20260811 07:16:56.925413 18648 raft_consensus.cc:2229] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:16:56.925544 18648 raft_consensus.cc:2258] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:16:56.925868 18650 ts_tablet_manager.cc:1905] T 80c21f77dc234d0bab2ae481abbdace0 P ad60737706654871b58fc79b814ce008: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:16:56.926040 18648 ts_tablet_manager.cc:1905] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:16:56.926640 17829 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:46605 (error 108)
I20260811 07:16:56.927330 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 18145
I20260811 07:16:56.929927 18648 ts_tablet_manager.cc:1918] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:16:56.930027 18648 log.cc:1196] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/80c21f77dc234d0bab2ae481abbdace0
I20260811 07:16:56.930325 18648 ts_tablet_manager.cc:1939] T 80c21f77dc234d0bab2ae481abbdace0 P f0d989ac8afc4967bd59f6876fc49042: Deleting consensus metadata
I20260811 07:16:56.930825 17830 catalog_manager.cc:4841] TS f0d989ac8afc4967bd59f6876fc49042 (127.9.142.131:37353): tablet 80c21f77dc234d0bab2ae481abbdace0 (table test-table [id=a2b51aa9bc214b4b925067075c43b312]) successfully deleted
I20260811 07:16:56.934120 18593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.933970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:46605 (local address 127.0.0.1:34504)
0811 07:16:56.934023 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.934078 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:46605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 07:16:56.934336 17829 catalog_manager.cc:4584] TS 416fd778ef7d4f91bbc8b2f3cd39d4ff (127.9.142.129:46605): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 80c21f77dc234d0bab2ae481abbdace0: Network error: Client connection negotiation failed: client connection to 127.9.142.129:46605: connect: Connection refused (error 111)
I20260811 07:16:56.939033 18593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:56.938892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:45907 (local address 127.0.0.1:55308)
0811 07:16:56.938951 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:56.938994 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.130:45907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 07:16:56.939028 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 18373
I20260811 07:16:56.951676 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 17800
2026-08-11T07:16:56Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (912 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 07:16:56.979647 9786 mini_oidc.cc:152] Starting JWKS server
I20260811 07:16:56.980875 9786 webserver.cc:460] Webserver started at https://127.0.0.1:41207/ using document root <none> and password file <none>
I20260811 07:16:56.981015 9786 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:16:56.981211 9786 webserver.cc:460] Webserver started at http://127.0.0.1:42773/ using document root <none> and password file <none>
2026-08-11T07:16:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:56Z Disabled control of system clock
I20260811 07:16:56.992197 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45977
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:37171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:45977
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41207/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/testchainca.cert with env {}
W20260811 07:16:57.079855 18664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:57.080077 18664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:57.080101 18664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:57.081211 18664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:57.081245 18664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:57.081259 18664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:57.081270 18664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:57.081282 18664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:16:57.081295 18664 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:16:57.081306 18664 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41207/jwks.json
I20260811 07:16:57.082767 18664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:37171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:45977
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41207/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:57.082979 18664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:57.083148 18664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:57.088044 18677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:57.088096 18675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:57.088099 18674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:57.088245 18664 server_base.cc:1034] running on GCE node
I20260811 07:16:57.088497 18664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:57.088833 18664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:57.090008 18664 hybrid_clock.cc:648] HybridClock initialized: now 1786432617089982 us; error 35 us; skew 500 ppm
I20260811 07:16:57.091228 18664 webserver.cc:460] Webserver started at http://127.9.142.190:39955/ using document root <none> and password file <none>
I20260811 07:16:57.091486 18664 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:57.091559 18664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:57.091722 18664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:57.092797 18664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "a397cc18493747f5b7834dcac014e06d"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "aa3ca7f674d3d1c2a4fd2232d12c8b5e"
server_key_iv: "bc909bd8a1ba5eaff3502fa305698e69"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.093185 18664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "a397cc18493747f5b7834dcac014e06d"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "aa3ca7f674d3d1c2a4fd2232d12c8b5e"
server_key_iv: "bc909bd8a1ba5eaff3502fa305698e69"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.094545 18664 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 07:16:57.095404 18689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:57.095600 18664 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:16:57.095722 18664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "a397cc18493747f5b7834dcac014e06d"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "aa3ca7f674d3d1c2a4fd2232d12c8b5e"
server_key_iv: "bc909bd8a1ba5eaff3502fa305698e69"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.095870 18664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:57.129753 18664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:57.130149 18664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:57.130333 18664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:57.134914 18664 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:45977
I20260811 07:16:57.134971 18772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:45977 every 8 connection(s)
I20260811 07:16:57.135385 18664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:57.136462 18773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:57.137725 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 18664
I20260811 07:16:57.137842 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:57.138041 9786 external_mini_cluster.cc:1428] Setting key 80168ddc5ef9fbe88ed70818fb06a174
I20260811 07:16:57.139299 18773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d: Bootstrap starting.
I20260811 07:16:57.139974 18773 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:57.140290 18773 log.cc:824] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:57.140974 18773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d: No bootstrap required, opened a new log
I20260811 07:16:57.142791 18773 raft_consensus.cc:348] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a397cc18493747f5b7834dcac014e06d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45977 } }
I20260811 07:16:57.142966 18773 raft_consensus.cc:374] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:57.143029 18773 raft_consensus.cc:729] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a397cc18493747f5b7834dcac014e06d, State: Initialized, Role: FOLLOWER
I20260811 07:16:57.143175 18773 consensus_queue.cc:260] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a397cc18493747f5b7834dcac014e06d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45977 } }
I20260811 07:16:57.143265 18773 raft_consensus.cc:388] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:57.143306 18773 raft_consensus.cc:482] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:57.143360 18773 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:57.143999 18776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:57.138600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48728 (local address 127.9.142.190:45977)
0811 07:16:57.138831 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:57.138839 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:57.138866 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:16:57.139310 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:57.139316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:57.139378 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:57.139584 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:57.139838 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.140919 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.141825 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.142276 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.142427 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.143211 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:57.143214 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:57.143215 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:57.143428 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:57.143473 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:57.143500 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:57.143579 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:57.143641 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 07:16:57.143725 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":83,"threads_started":1}
I20260811 07:16:57.144097 18773 raft_consensus.cc:504] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a397cc18493747f5b7834dcac014e06d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45977 } }
I20260811 07:16:57.144194 18773 leader_election.cc:302] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a397cc18493747f5b7834dcac014e06d; no voters:
I20260811 07:16:57.144392 18773 leader_election.cc:288] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:57.144477 18778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:57.144636 18778 raft_consensus.cc:686] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [term 1 LEADER]: Becoming Leader. State: Replica: a397cc18493747f5b7834dcac014e06d, State: Running, Role: LEADER
I20260811 07:16:57.144666 18773 sys_catalog.cc:564] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:57.144723 18778 consensus_queue.cc:237] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a397cc18493747f5b7834dcac014e06d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45977 } }
I20260811 07:16:57.145066 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:16:57.145048 18779 sys_catalog.cc:455] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a397cc18493747f5b7834dcac014e06d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a397cc18493747f5b7834dcac014e06d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45977 } } }
I20260811 07:16:57.145128 18779 sys_catalog.cc:458] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:57.145295 18781 sys_catalog.cc:455] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a397cc18493747f5b7834dcac014e06d. Latest consensus state: current_term: 1 leader_uuid: "a397cc18493747f5b7834dcac014e06d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a397cc18493747f5b7834dcac014e06d" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45977 } } }
I20260811 07:16:57.145347 18781 sys_catalog.cc:458] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:57.145442 18786 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:57.145956 18786 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:57.148510 18815 mvcc.cc:205] Tried to move back new op lower bound from 7317227999833382912 to 7317227999825133568. Current Snapshot: MvccSnapshot[applied={T|T < 7317227999833382912}]
I20260811 07:16:57.148871 18786 catalog_manager.cc:1347] Generated new cluster ID: fc440d68c00f4b13a6f0519166b20d4a
I20260811 07:16:57.148928 18786 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:16:57.180043 18786 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:57.180612 18786 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:57.184998 18786 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a397cc18493747f5b7834dcac014e06d: Generated new TSK 0
I20260811 07:16:57.185194 18786 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 07:16:57.215063 18830 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 07:16:57.215301 18830 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 07:16:57.215306 18776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:57.193621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48736 (local address 127.9.142.190:45977)
0811 07:16:57.193694 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:57.193697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:57.193851 (+ 154us) server_negotiation.cc:407] Connection header received
0811 07:16:57.193962 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:57.193964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:57.193977 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:57.194058 (+ 81us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:16:57.194228 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.194714 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.195514 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.195711 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.195823 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.196056 (+ 233us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:16:57.215023 (+ 18967us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41207/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 07:16:57.215232 (+ 209us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48736: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41207/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 07:16:57.215401 18776 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48736: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41207/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 07:16:57.215950 18826 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:16:57.193548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45977 (local address 127.0.0.1:48736)
0811 07:16:57.193783 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:57.193792 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:57.193875 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:57.194072 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:57.194073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:57.194075 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:16:57.194147 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:57.194152 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.194807 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.194808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:57.195419 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:57.195421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.195828 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.195830 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:57.195901 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.195928 (+ 27us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:16:57.215191 (+ 19263us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41207/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 07:16:57.215617 (+ 426us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.142.190:45977: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41207/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":113,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.9.142.190:45977: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41207/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 07:16:57.216527 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 18664
2026-08-11T07:16:57Z chronyd exiting
I20260811 07:16:57.259375 9786 test_util.cc:175] -----------------------------------------------
I20260811 07:16:57.259478 9786 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786432592145333-9786-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (280 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 07:16:57.260391 9786 mini_oidc.cc:152] Starting JWKS server
I20260811 07:16:57.261113 9786 webserver.cc:460] Webserver started at https://127.0.0.1:43183/ using document root <none> and password file <none>
I20260811 07:16:57.261185 9786 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:16:57.261332 9786 webserver.cc:460] Webserver started at http://127.0.0.1:37145/ using document root <none> and password file <none>
2026-08-11T07:16:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:57Z Disabled control of system clock
I20260811 07:16:57.270980 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33625
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:43033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:33625
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43183/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/testchainca.cert with env {}
W20260811 07:16:57.355638 18839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:57.355875 18839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:57.355896 18839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:57.356997 18839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:57.357030 18839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:57.357043 18839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:57.357055 18839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:57.357067 18839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:16:57.357080 18839 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:16:57.357091 18839 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43183/jwks.json
I20260811 07:16:57.358565 18839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:43033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:33625
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43183/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:57.358765 18839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:57.358927 18839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:57.363718 18845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:57.363821 18839 server_base.cc:1034] running on GCE node
W20260811 07:16:57.363780 18846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:57.363716 18855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:57.364259 18839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:57.364565 18839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:57.365703 18839 hybrid_clock.cc:648] HybridClock initialized: now 1786432617365681 us; error 36 us; skew 500 ppm
I20260811 07:16:57.366915 18839 webserver.cc:460] Webserver started at http://127.9.142.190:32827/ using document root <none> and password file <none>
I20260811 07:16:57.367122 18839 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:57.367164 18839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:57.367251 18839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:57.368311 18839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "a152a2d95b8b47d9970e8a90940c7aa3"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "b32149e3b9a24adb4f4d04065d4c4b88"
server_key_iv: "6a9ce9c772dd82b789a70648f42e4f00"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.368633 18839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "a152a2d95b8b47d9970e8a90940c7aa3"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "b32149e3b9a24adb4f4d04065d4c4b88"
server_key_iv: "6a9ce9c772dd82b789a70648f42e4f00"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.369897 18839 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 07:16:57.370594 18862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:57.370793 18839 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:57.370884 18839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "a152a2d95b8b47d9970e8a90940c7aa3"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "b32149e3b9a24adb4f4d04065d4c4b88"
server_key_iv: "6a9ce9c772dd82b789a70648f42e4f00"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.370940 18839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:57.379921 18839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:57.380152 18839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:57.380250 18839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:57.384084 18839 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:33625
I20260811 07:16:57.384117 18954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:33625 every 8 connection(s)
I20260811 07:16:57.384465 18839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:57.385540 18955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:57.385613 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 18839
I20260811 07:16:57.385720 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:57.385934 9786 external_mini_cluster.cc:1428] Setting key 990b63c9938860f165672e2c776661a2
I20260811 07:16:57.389252 18955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3: Bootstrap starting.
I20260811 07:16:57.390033 18955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:57.390338 18955 log.cc:824] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:57.391095 18955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3: No bootstrap required, opened a new log
I20260811 07:16:57.392524 18960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:57.386579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55662 (local address 127.9.142.190:33625)
0811 07:16:57.386839 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:57.386848 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:57.386880 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:16:57.387377 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:57.387386 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:57.387475 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:57.387625 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:57.387912 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.389260 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.390487 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.390913 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.391017 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.391728 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:57.391732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:57.391732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:57.391971 (+ 239us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:57.392005 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:57.392017 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:57.392076 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:57.392185 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 07:16:57.392319 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":79,"threads_started":1}
I20260811 07:16:57.393759 18955 raft_consensus.cc:348] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a152a2d95b8b47d9970e8a90940c7aa3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33625 } }
I20260811 07:16:57.393951 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:16:57.393985 18955 raft_consensus.cc:374] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:57.394025 18955 raft_consensus.cc:729] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a152a2d95b8b47d9970e8a90940c7aa3, State: Initialized, Role: FOLLOWER
I20260811 07:16:57.394140 18955 consensus_queue.cc:260] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a152a2d95b8b47d9970e8a90940c7aa3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33625 } }
I20260811 07:16:57.394215 18955 raft_consensus.cc:388] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:57.394243 18955 raft_consensus.cc:482] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:57.394280 18955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:57.395035 18955 raft_consensus.cc:504] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a152a2d95b8b47d9970e8a90940c7aa3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33625 } }
I20260811 07:16:57.395177 18955 leader_election.cc:302] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a152a2d95b8b47d9970e8a90940c7aa3; no voters:
I20260811 07:16:57.395391 18955 leader_election.cc:288] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:57.395447 18963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:57.395653 18963 raft_consensus.cc:686] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [term 1 LEADER]: Becoming Leader. State: Replica: a152a2d95b8b47d9970e8a90940c7aa3, State: Running, Role: LEADER
I20260811 07:16:57.395656 18955 sys_catalog.cc:564] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:57.395776 18963 consensus_queue.cc:237] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a152a2d95b8b47d9970e8a90940c7aa3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33625 } }
I20260811 07:16:57.396166 18964 sys_catalog.cc:455] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a152a2d95b8b47d9970e8a90940c7aa3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a152a2d95b8b47d9970e8a90940c7aa3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33625 } } }
I20260811 07:16:57.396168 18965 sys_catalog.cc:455] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a152a2d95b8b47d9970e8a90940c7aa3. Latest consensus state: current_term: 1 leader_uuid: "a152a2d95b8b47d9970e8a90940c7aa3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a152a2d95b8b47d9970e8a90940c7aa3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33625 } } }
I20260811 07:16:57.396313 18964 sys_catalog.cc:458] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:57.396337 18965 sys_catalog.cc:458] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:57.396696 18977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:57.397248 18977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:57.399003 18977 catalog_manager.cc:1347] Generated new cluster ID: 5be2d00a1e284f1095314177a08e664a
I20260811 07:16:57.399086 18977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:16:57.404135 18977 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:57.404667 18977 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:57.407100 18977 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a152a2d95b8b47d9970e8a90940c7aa3: Generated new TSK 0
I20260811 07:16:57.407269 18977 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 07:16:57.427699 19010 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 07:16:57.427826 19010 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 07:16:57.428194 18960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:57.413182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55672 (local address 127.9.142.190:33625)
0811 07:16:57.413230 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:57.413246 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:57.413372 (+ 126us) server_negotiation.cc:407] Connection header received
0811 07:16:57.413453 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:57.413454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:57.413469 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:57.413550 (+ 81us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:16:57.413694 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.414190 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.414995 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.415199 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.415275 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.415458 (+ 183us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:16:57.427939 (+ 12481us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 07:16:57.428112 (+ 173us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55672: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 07:16:57.428259 18960 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55672: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 07:16:57.428274 19008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:16:57.413145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33625 (local address 127.0.0.1:55672)
0811 07:16:57.413293 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:57.413304 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:57.413391 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:57.413550 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:57.413551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:57.413553 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:16:57.413613 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:57.413616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.414299 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.414301 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:57.414904 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:57.414907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.415277 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.415278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:57.415340 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.415345 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:16:57.428056 (+ 12711us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 07:16:57.428170 (+ 114us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.142.190:33625: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260811 07:16:57.428808 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 18839
2026-08-11T07:16:57Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (216 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 07:16:57.476868 9786 mini_oidc.cc:152] Starting JWKS server
I20260811 07:16:57.477602 9786 webserver.cc:460] Webserver started at https://127.0.0.1:38113/ using document root <none> and password file <none>
I20260811 07:16:57.477674 9786 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:16:57.477838 9786 webserver.cc:460] Webserver started at http://127.0.0.1:37851/ using document root <none> and password file <none>
2026-08-11T07:16:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:57Z Disabled control of system clock
I20260811 07:16:57.487071 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:37001
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:37001
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38113/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 07:16:57.572623 19029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:57.572855 19029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:57.572878 19029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:57.574074 19029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:57.574116 19029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:57.574131 19029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:57.574142 19029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:57.574155 19029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:16:57.574167 19029 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:16:57.574225 19029 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38113/jwks.json
I20260811 07:16:57.575596 19029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:37001
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:37001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38113/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:57.575901 19029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:57.576210 19029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:16:57.581382 19029 server_base.cc:1034] running on GCE node
W20260811 07:16:57.581496 19042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:57.581528 19045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:57.581583 19040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:57.581871 19029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:57.582216 19029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:57.583591 19029 hybrid_clock.cc:648] HybridClock initialized: now 1786432617583562 us; error 36 us; skew 500 ppm
I20260811 07:16:57.585021 19029 webserver.cc:460] Webserver started at http://127.9.142.190:36499/ using document root <none> and password file <none>
I20260811 07:16:57.585314 19029 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:57.585403 19029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:57.585582 19029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:57.586792 19029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "c16cb3087d964889981c97bf56f27809"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "d1313476a0b999b9192dc33b91e6cfc2"
server_key_iv: "b4f68b7692b99deb721c27c17dfcc099"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.587221 19029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "c16cb3087d964889981c97bf56f27809"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "d1313476a0b999b9192dc33b91e6cfc2"
server_key_iv: "b4f68b7692b99deb721c27c17dfcc099"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.588773 19029 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260811 07:16:57.589644 19053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:57.589859 19029 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:57.589993 19029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "c16cb3087d964889981c97bf56f27809"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "d1313476a0b999b9192dc33b91e6cfc2"
server_key_iv: "b4f68b7692b99deb721c27c17dfcc099"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.590078 19029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:57.608829 19029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:57.609200 19029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:57.609361 19029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:57.613790 19029 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:37001
I20260811 07:16:57.613824 19142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:37001 every 8 connection(s)
I20260811 07:16:57.614202 19029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:57.614971 19143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:57.617981 19143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809: Bootstrap starting.
I20260811 07:16:57.618611 19143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:57.618928 19143 log.cc:824] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:57.619686 19143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809: No bootstrap required, opened a new log
I20260811 07:16:57.621367 19143 raft_consensus.cc:348] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c16cb3087d964889981c97bf56f27809" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37001 } }
I20260811 07:16:57.621521 19143 raft_consensus.cc:374] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:57.621546 19143 raft_consensus.cc:729] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c16cb3087d964889981c97bf56f27809, State: Initialized, Role: FOLLOWER
I20260811 07:16:57.621655 19143 consensus_queue.cc:260] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c16cb3087d964889981c97bf56f27809" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37001 } }
I20260811 07:16:57.621742 19143 raft_consensus.cc:388] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:57.621779 19143 raft_consensus.cc:482] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:57.621853 19143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:57.622131 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 19029
I20260811 07:16:57.622218 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:57.622404 9786 external_mini_cluster.cc:1428] Setting key fb1b1e5c8a93b3933307e911bbcce5e8
I20260811 07:16:57.622601 19143 raft_consensus.cc:504] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c16cb3087d964889981c97bf56f27809" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37001 } }
I20260811 07:16:57.622728 19143 leader_election.cc:302] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c16cb3087d964889981c97bf56f27809; no voters:
I20260811 07:16:57.622898 19143 leader_election.cc:288] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:57.623250 19143 sys_catalog.cc:564] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:57.623878 19154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:57.624102 19154 raft_consensus.cc:686] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [term 1 LEADER]: Becoming Leader. State: Replica: c16cb3087d964889981c97bf56f27809, State: Running, Role: LEADER
I20260811 07:16:57.624251 19154 consensus_queue.cc:237] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c16cb3087d964889981c97bf56f27809" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37001 } }
I20260811 07:16:57.625352 19161 sys_catalog.cc:455] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c16cb3087d964889981c97bf56f27809" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c16cb3087d964889981c97bf56f27809" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37001 } } }
I20260811 07:16:57.625453 19161 sys_catalog.cc:458] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:57.625613 19161 sys_catalog.cc:455] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c16cb3087d964889981c97bf56f27809. Latest consensus state: current_term: 1 leader_uuid: "c16cb3087d964889981c97bf56f27809" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c16cb3087d964889981c97bf56f27809" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37001 } } }
I20260811 07:16:57.625663 19161 sys_catalog.cc:458] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809 [sys.catalog]: This master's current role is: LEADER
W20260811 07:16:57.627785 19171 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:16:57.627871 19171 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:16:57.628015 19174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:57.628237 19174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:57.629879 19174 catalog_manager.cc:1347] Generated new cluster ID: a3f09ff274a348c88f3e68832ece81cf
I20260811 07:16:57.629941 19174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:16:57.630592 19152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:57.622929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52324 (local address 127.9.142.190:37001)
0811 07:16:57.624237 (+ 1308us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:57.624246 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:57.624288 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:16:57.624626 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:57.624641 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:57.624895 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:57.625340 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:57.625440 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.626784 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.627663 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.628372 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.628657 (+ 285us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.629678 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:57.629681 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:57.629682 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:57.629911 (+ 229us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:57.629957 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:57.629973 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:57.630079 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:57.630185 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 07:16:57.630266 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1190,"thread_start_us":87,"threads_started":1}
I20260811 07:16:57.631716 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:16:57.639596 19174 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:57.640321 19174 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:57.647857 19174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c16cb3087d964889981c97bf56f27809: Generated new TSK 0
I20260811 07:16:57.648113 19174 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:16:57.662488 19152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:57.657816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52340 (local address 127.9.142.190:37001)
0811 07:16:57.657870 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:57.657872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:57.657982 (+ 110us) server_negotiation.cc:407] Connection header received
0811 07:16:57.658101 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:57.658102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:57.658116 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:57.658193 (+ 77us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:16:57.658375 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.658867 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.660223 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.660494 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.660557 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.660770 (+ 213us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:16:57.662153 (+ 1383us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38113/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 07:16:57.662409 (+ 256us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52340: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38113/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 07:16:57.662580 19152 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52340: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38113/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 07:16:57.665777 19186 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:16:57.657708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:37001 (local address 127.0.0.1:52340)
0811 07:16:57.657896 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:57.657909 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:57.657987 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:57.658209 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:57.658211 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:57.658213 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:16:57.658296 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:57.658299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.658972 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.658973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:57.660103 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:57.660107 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.660587 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.660589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:57.660656 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.660662 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:16:57.662319 (+ 1657us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38113/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 07:16:57.665693 (+ 3374us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.142.190:37001: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38113/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":3185,"thread_start_us":110,"threads_started":1}
I20260811 07:16:57.666467 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 19029
E20260811 07:16:57.680049 19190 webserver.cc:533] Webserver: sslize failed:
E20260811 07:16:57.680186 19190 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T07:16:57Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (236 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T07:16:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:57Z Disabled control of system clock
I20260811 07:16:57.723555 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33093
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:34531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:33093
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/testchainca.cert with env {}
W20260811 07:16:57.809108 19196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:16:57.809314 19196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:16:57.809337 19196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:16:57.810526 19196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:16:57.810567 19196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:16:57.810580 19196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:16:57.810592 19196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:16:57.810604 19196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:16:57.810616 19196 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:16:57.810667 19196 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 07:16:57.812182 19196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:33093
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:16:57.812443 19196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:16:57.812664 19196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:16:57.817395 19206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:57.817405 19205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:16:57.817405 19209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:16:57.817812 19196 server_base.cc:1034] running on GCE node
I20260811 07:16:57.818101 19196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:16:57.818392 19196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:16:57.819558 19196 hybrid_clock.cc:648] HybridClock initialized: now 1786432617819552 us; error 36 us; skew 500 ppm
I20260811 07:16:57.820864 19196 webserver.cc:460] Webserver started at http://127.9.142.190:42031/ using document root <none> and password file <none>
I20260811 07:16:57.821139 19196 fs_manager.cc:359] Metadata directory not provided
I20260811 07:16:57.821216 19196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:16:57.821370 19196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:16:57.822412 19196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "f0e0423b03c146189998c931b11b41e5"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "2f4fded05c9eab2b8794f82b99d3beb0"
server_key_iv: "00b8a4ee844d91e8b982692bfffe3faf"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.822777 19196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "f0e0423b03c146189998c931b11b41e5"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "2f4fded05c9eab2b8794f82b99d3beb0"
server_key_iv: "00b8a4ee844d91e8b982692bfffe3faf"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.824147 19196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 07:16:57.824931 19219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:16:57.825124 19196 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:16:57.825217 19196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "f0e0423b03c146189998c931b11b41e5"
format_stamp: "Formatted at 2026-08-11 07:16:57 on dist-test-slave-7f01"
server_key: "2f4fded05c9eab2b8794f82b99d3beb0"
server_key_iv: "00b8a4ee844d91e8b982692bfffe3faf"
server_key_version: "encryptionkey@0"
I20260811 07:16:57.825302 19196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:16:57.838521 19196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:16:57.838842 19196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:16:57.839011 19196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:16:57.843282 19196 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:33093
I20260811 07:16:57.843317 19308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:33093 every 8 connection(s)
I20260811 07:16:57.843700 19196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:16:57.844729 19310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:16:57.847150 19310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5: Bootstrap starting.
I20260811 07:16:57.847782 19310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5: Neither blocks nor log segments found. Creating new log.
I20260811 07:16:57.848112 19310 log.cc:824] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:16:57.848629 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 19196
I20260811 07:16:57.848759 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:16:57.848959 9786 external_mini_cluster.cc:1428] Setting key 0565f4fa76b48101adbed201b3f9949a
I20260811 07:16:57.848973 19310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5: No bootstrap required, opened a new log
I20260811 07:16:57.852092 19310 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0e0423b03c146189998c931b11b41e5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33093 } }
I20260811 07:16:57.852265 19310 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:16:57.852298 19310 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0e0423b03c146189998c931b11b41e5, State: Initialized, Role: FOLLOWER
I20260811 07:16:57.852415 19310 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0e0423b03c146189998c931b11b41e5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33093 } }
I20260811 07:16:57.852504 19310 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:16:57.852545 19310 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:16:57.852603 19310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:16:57.853176 19310 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0e0423b03c146189998c931b11b41e5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33093 } }
I20260811 07:16:57.853307 19310 leader_election.cc:302] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0e0423b03c146189998c931b11b41e5; no voters:
I20260811 07:16:57.853482 19310 leader_election.cc:288] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:16:57.853531 19319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:16:57.853688 19319 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [term 1 LEADER]: Becoming Leader. State: Replica: f0e0423b03c146189998c931b11b41e5, State: Running, Role: LEADER
I20260811 07:16:57.853780 19319 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0e0423b03c146189998c931b11b41e5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33093 } }
I20260811 07:16:57.853781 19310 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:16:57.855014 19320 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0e0423b03c146189998c931b11b41e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0e0423b03c146189998c931b11b41e5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33093 } } }
I20260811 07:16:57.855122 19320 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:57.855335 19345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:16:57.855613 19321 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0e0423b03c146189998c931b11b41e5. Latest consensus state: current_term: 1 leader_uuid: "f0e0423b03c146189998c931b11b41e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0e0423b03c146189998c931b11b41e5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33093 } } }
I20260811 07:16:57.855698 19321 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:16:57.855973 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:57.849525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50786 (local address 127.9.142.190:33093)
0811 07:16:57.849758 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:57.849768 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:57.849805 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:16:57.850522 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:57.850531 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:57.850610 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:57.850765 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:16:57.850989 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.852462 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.853311 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.853979 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.854145 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.854995 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:16:57.855000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:16:57.855000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:16:57.855240 (+ 240us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:16:57.855286 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:16:57.855302 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:16:57.855385 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:16:57.855669 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 07:16:57.855773 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":88,"threads_started":1}
I20260811 07:16:57.856182 19345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:16:57.856976 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:16:57.858196 19345 catalog_manager.cc:1347] Generated new cluster ID: 8cb5a836222d48f885ab990a74ba89de
I20260811 07:16:57.858249 19345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:16:57.869460 19345 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:16:57.870162 19345 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:16:57.873693 19345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0e0423b03c146189998c931b11b41e5: Generated new TSK 0
I20260811 07:16:57.873873 19345 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:16:58.406343 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:16:57.883227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50792 (local address 127.9.142.190:33093)
0811 07:16:57.883587 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0811 07:16:57.883590 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:16:57.883597 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:16:57.883632 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:16:57.883633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:16:57.883654 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:16:57.883741 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:16:57.883919 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.884419 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.885265 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.885604 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.885672 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.885966 (+ 294us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:16:58.405983 (+520017us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 07:16:58.406245 (+ 262us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50792: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":336}
W20260811 07:16:58.406437 19317 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50792: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 07:16:58.406452 19364 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:16:57.883130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33093 (local address 127.0.0.1:50792)
0811 07:16:57.883380 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 07:16:57.883393 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:16:57.883453 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:16:57.883761 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:16:57.883762 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:16:57.883764 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:16:57.883833 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:57.883835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.884527 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.884528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:57.885156 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:16:57.885158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:16:57.885731 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:16:57.885732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:16:57.885813 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:16:57.885822 (+ 9us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:16:58.406196 (+520374us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 07:16:58.406327 (+ 131us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.142.190:33093: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":90,"threads_started":1}
I20260811 07:16:58.406706 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 19196
2026-08-11T07:16:58Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (718 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (92 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (91 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:16:58 dist-test-slave-7f01 krb5kdc[19378](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:16:58 dist-test-slave-7f01 krb5kdc[19378](info): set up 2 sockets
Aug 11 07:16:58 dist-test-slave-7f01 krb5kdc[19378](info): commencing operation
krb5kdc: starting...
W20260811 07:16:59.868548 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:16:59 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:16:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:16:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:17:00.006049 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33259
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:33259
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:00.091888 19405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:00.092126 19405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:00.092161 19405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:00.093331 19405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:00.093412 19405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:00.093439 19405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:00.093469 19405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:00.093499 19405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:00.094966 19405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:33259
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:00.095247 19405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:00.095479 19405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:00.100485 19413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:00.100476 19417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:00.100492 19414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:00.100894 19405 server_base.cc:1034] running on GCE node
I20260811 07:17:00.101115 19405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:00.101354 19405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:00.102521 19405 hybrid_clock.cc:648] HybridClock initialized: now 1786432620102500 us; error 37 us; skew 500 ppm
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.105115 19405 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:17:00.105597 19405 webserver.cc:460] Webserver started at http://127.9.142.190:42109/ using document root <none> and password file <none>
I20260811 07:17:00.105839 19405 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:00.105908 19405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:00.106068 19405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:00.107111 19405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "76665319a5004039b3d8ffb8a111b39f"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "d7737d7ef953e7911ec05c0c81ce57bf"
server_key_iv: "624f822c139b2f209c95af645cb7ccb3"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.107482 19405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "76665319a5004039b3d8ffb8a111b39f"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "d7737d7ef953e7911ec05c0c81ce57bf"
server_key_iv: "624f822c139b2f209c95af645cb7ccb3"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.108911 19405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:17:00.109668 19431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.109865 19405 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:00.109979 19405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "76665319a5004039b3d8ffb8a111b39f"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "d7737d7ef953e7911ec05c0c81ce57bf"
server_key_iv: "624f822c139b2f209c95af645cb7ccb3"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.110069 19405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:00.118062 19405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:00.119940 19405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:00.120100 19405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:00.124424 19405 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:33259
I20260811 07:17:00.124473 19517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:33259 every 8 connection(s)
I20260811 07:17:00.124837 19405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:17:00.125694 19518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:00.128079 19518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f: Bootstrap starting.
I20260811 07:17:00.128825 19518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:00.129172 19518 log.cc:824] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:00.130823 19518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f: No bootstrap required, opened a new log
I20260811 07:17:00.130903 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 19405
I20260811 07:17:00.131031 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:17:00.131228 9786 external_mini_cluster.cc:1428] Setting key fd595754d379cdbb34ea7626abe47d95
I20260811 07:17:00.132905 19518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76665319a5004039b3d8ffb8a111b39f" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33259 } }
I20260811 07:17:00.133081 19518 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:00.133122 19518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76665319a5004039b3d8ffb8a111b39f, State: Initialized, Role: FOLLOWER
I20260811 07:17:00.133265 19518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76665319a5004039b3d8ffb8a111b39f" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33259 } }
I20260811 07:17:00.133361 19518 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:17:00.133400 19518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:17:00.133455 19518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:00.134509 19518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76665319a5004039b3d8ffb8a111b39f" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33259 } }
I20260811 07:17:00.134608 19518 leader_election.cc:302] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76665319a5004039b3d8ffb8a111b39f; no voters:
I20260811 07:17:00.134824 19518 leader_election.cc:288] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:17:00.134860 19526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:00.134984 19526 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [term 1 LEADER]: Becoming Leader. State: Replica: 76665319a5004039b3d8ffb8a111b39f, State: Running, Role: LEADER
I20260811 07:17:00.135098 19518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:00.135069 19526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76665319a5004039b3d8ffb8a111b39f" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33259 } }
I20260811 07:17:00.135447 19526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76665319a5004039b3d8ffb8a111b39f. Latest consensus state: current_term: 1 leader_uuid: "76665319a5004039b3d8ffb8a111b39f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76665319a5004039b3d8ffb8a111b39f" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33259 } } }
I20260811 07:17:00.135528 19526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:00.135731 19527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76665319a5004039b3d8ffb8a111b39f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76665319a5004039b3d8ffb8a111b39f" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33259 } } }
I20260811 07:17:00.135840 19527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:00.136298 19538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:17:00.136808 19538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:00.139091 19538 catalog_manager.cc:1347] Generated new cluster ID: c376e0944b9b40999f04032d2b4ed628
I20260811 07:17:00.139146 19538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:17:00.144106 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.131770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39468 (local address 127.9.142.190:33259)
0811 07:17:00.131970 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.131977 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.132008 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:17:00.132884 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.132891 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.132937 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.133056 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.133921 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.134947 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.136064 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.136661 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.136779 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.140217 (+ 3438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:00.140220 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:00.140220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:00.140230 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:00.142073 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.142454 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.142463 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.142464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.142576 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.142798 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.142799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.142800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.143036 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:00.143789 (+ 753us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:00.143860 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 07:17:00.143964 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":105,"threads_started":1}
I20260811 07:17:00.145579 19538 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:17:00.146160 19538 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:17:00.152112 19538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76665319a5004039b3d8ffb8a111b39f: Generated new TSK 0
I20260811 07:17:00.152290 19538 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:17:00.184762 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33259
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:00.290863 19567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:00.291071 19567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:00.291096 19567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:00.292330 19567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:00.292373 19567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:00.292400 19567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:17:00.293911 19567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:00.294150 19567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:00.294399 19567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:00.299507 19578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:00.299527 19581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:00.299499 19577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:00.299799 19567 server_base.cc:1034] running on GCE node
I20260811 07:17:00.300076 19567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:00.300349 19567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:00.301533 19567 hybrid_clock.cc:648] HybridClock initialized: now 1786432620301518 us; error 44 us; skew 500 ppm
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.304152 19567 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:17:00.304644 19567 webserver.cc:460] Webserver started at http://127.9.142.129:36709/ using document root <none> and password file <none>
I20260811 07:17:00.304888 19567 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:00.304957 19567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:00.305097 19567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:00.306221 19567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "bbb23ecc99ca40bab495ccb0d2c59cfc"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "a1c4abf6d2b0565493c14478a3c77b6b"
server_key_iv: "66798b3944aba958d1bf0a24066f430c"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.306588 19567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "bbb23ecc99ca40bab495ccb0d2c59cfc"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "a1c4abf6d2b0565493c14478a3c77b6b"
server_key_iv: "66798b3944aba958d1bf0a24066f430c"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.308002 19567 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 07:17:00.308720 19592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.308923 19567 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:00.309037 19567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "bbb23ecc99ca40bab495ccb0d2c59cfc"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "a1c4abf6d2b0565493c14478a3c77b6b"
server_key_iv: "66798b3944aba958d1bf0a24066f430c"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.309113 19567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:00.348192 19567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:00.350334 19567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:00.350528 19567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:00.350782 19567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:00.351130 19567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:00.351188 19567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.351233 19567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:00.351256 19567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.357585 19567 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:34087
I20260811 07:17:00.357626 19779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:34087 every 8 connection(s)
I20260811 07:17:00.358019 19567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:17:00.361146 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 19567
I20260811 07:17:00.361238 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:17:00.361459 9786 external_mini_cluster.cc:1428] Setting key 8bee81dcf89a7c7eb9eb6e5289ed5141
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:00.368512 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.358766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33259 (local address 127.9.142.129:46667)
0811 07:17:00.358959 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:00.358994 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:00.360057 (+ 1063us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:00.360350 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:00.360353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:00.360616 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:00.360804 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:00.360808 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.361657 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.361658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:00.362474 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:00.362477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.362882 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.362883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:00.363009 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.363532 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:00.363540 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:00.365121 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:00.367114 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:00.367121 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:00.367122 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:00.367343 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:00.367567 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:00.367568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:00.367568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:00.367668 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:00.368016 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:00.368022 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:00.368138 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 07:17:00.368224 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 07:17:00.368346 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":100,"threads_started":1}
I20260811 07:17:00.368517 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.358803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:46667 (local address 127.9.142.190:33259)
0811 07:17:00.358849 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.358851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.359080 (+ 229us) server_negotiation.cc:407] Connection header received
0811 07:17:00.360180 (+ 1100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.360181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.360199 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.360246 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.360910 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.361558 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.362570 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.362795 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.362881 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.365209 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:00.365210 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:00.365211 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:00.365221 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:00.367023 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.367426 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.367427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.367428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.367494 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.367769 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.367770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.367770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.367939 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:00.368019 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:00.368279 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 07:17:00.368378 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:17:00.369100 19781 heartbeater.cc:347] Connected to a master server at 127.9.142.190:33259
I20260811 07:17:00.369215 19781 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:00.369431 19781 heartbeater.cc:511] Master 127.9.142.190:33259 requested a full tablet report, sending...
I20260811 07:17:00.370003 19466 ts_manager.cc:194] Registered new tserver with Master: bbb23ecc99ca40bab495ccb0d2c59cfc (127.9.142.129:34087)
I20260811 07:17:00.370656 19466 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:46667
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:17:00.390719 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33259
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:00.475073 19786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:00.475266 19786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:00.475289 19786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:00.476361 19786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:00.476397 19786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:00.476423 19786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:17:00.477810 19786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:00.477990 19786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:00.478161 19786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:00.483269 19799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:00.483269 19794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:00.483295 19795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:00.483471 19786 server_base.cc:1034] running on GCE node
I20260811 07:17:00.483803 19786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:00.484089 19786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:00.485257 19786 hybrid_clock.cc:648] HybridClock initialized: now 1786432620485232 us; error 38 us; skew 500 ppm
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.488046 19786 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:17:00.488517 19786 webserver.cc:460] Webserver started at http://127.9.142.130:39473/ using document root <none> and password file <none>
I20260811 07:17:00.488781 19786 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:00.488857 19786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:00.489012 19786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:00.490116 19786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "60ca9930b2a84b878080b0e9f2cc2b26"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "988caff47631bc1edd1ced9a4c1eba7b"
server_key_iv: "33630d3883e23a282bc710e8bbb5a1a4"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.490500 19786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "60ca9930b2a84b878080b0e9f2cc2b26"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "988caff47631bc1edd1ced9a4c1eba7b"
server_key_iv: "33630d3883e23a282bc710e8bbb5a1a4"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.491972 19786 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:17:00.492726 19812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.492892 19786 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:00.492990 19786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "60ca9930b2a84b878080b0e9f2cc2b26"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "988caff47631bc1edd1ced9a4c1eba7b"
server_key_iv: "33630d3883e23a282bc710e8bbb5a1a4"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.493074 19786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:00.516112 19786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:00.518499 19786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:00.518669 19786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:00.518924 19786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:00.519245 19786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:00.519301 19786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.519342 19786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:00.519371 19786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.525251 19786 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:35487
I20260811 07:17:00.525363 20019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:35487 every 8 connection(s)
I20260811 07:17:00.525661 19786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:17:00.526572 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 19786
I20260811 07:17:00.526696 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:17:00.526926 9786 external_mini_cluster.cc:1428] Setting key b2a685de5c1b9634f736c7b066349051
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
I20260811 07:17:00.536761 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.526375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:45293 (local address 127.9.142.190:33259)
0811 07:17:00.526467 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.526469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.526722 (+ 253us) server_negotiation.cc:407] Connection header received
0811 07:17:00.528116 (+ 1394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.528117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.528128 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.528177 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.529009 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.529581 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.530573 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.530885 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.530963 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.533571 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:00.533572 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:00.533572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:00.533579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:00.535088 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.535562 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.535563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.535564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.535618 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.536008 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.536009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.536010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.536171 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:00.536240 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:00.536566 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 07:17:00.536639 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:17:00.536947 20022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.526347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33259 (local address 127.9.142.130:45293)
0811 07:17:00.526575 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:00.526625 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:00.528004 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:00.528243 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:00.528247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:00.528643 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:00.528919 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:00.528925 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.529688 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.529688 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:00.530491 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:00.530493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.530974 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.530975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:00.531082 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.531582 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:00.531591 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:00.533476 (+ 1885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:00.535170 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:00.535179 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:00.535181 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:00.535487 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:00.535689 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:00.535689 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:00.535690 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:00.535855 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:00.536246 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:00.536254 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:00.536423 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 07:17:00.536525 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 07:17:00.536698 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":123,"threads_started":1}
I20260811 07:17:00.537405 20020 heartbeater.cc:347] Connected to a master server at 127.9.142.190:33259
I20260811 07:17:00.537518 20020 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:00.537709 20020 heartbeater.cc:511] Master 127.9.142.190:33259 requested a full tablet report, sending...
I20260811 07:17:00.538113 19466 ts_manager.cc:194] Registered new tserver with Master: 60ca9930b2a84b878080b0e9f2cc2b26 (127.9.142.130:35487)
I20260811 07:17:00.538460 19466 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:45293
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:17:00.553905 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33259
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:00.637894 20031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:00.638120 20031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:00.638160 20031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:00.639288 20031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:00.639354 20031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:00.639400 20031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:17:00.640921 20031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:00.641201 20031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:00.641455 20031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:00.646387 20046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:00.646427 20031 server_base.cc:1034] running on GCE node
W20260811 07:17:00.646399 20041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:00.646425 20037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:00.646824 20031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:00.647095 20031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:00.648248 20031 hybrid_clock.cc:648] HybridClock initialized: now 1786432620648227 us; error 39 us; skew 500 ppm
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.650717 20031 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:17:00.651137 20031 webserver.cc:460] Webserver started at http://127.9.142.131:40975/ using document root <none> and password file <none>
I20260811 07:17:00.651361 20031 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:00.651437 20031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:00.651592 20031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:00.652814 20031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "da35f343263f4b5c9197c3c9bad8017a"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "2d806b1b1d60e5034757f2cf891737d8"
server_key_iv: "076136ee23106af65d8af5d9fc6c1d9d"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.653180 20031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "da35f343263f4b5c9197c3c9bad8017a"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "2d806b1b1d60e5034757f2cf891737d8"
server_key_iv: "076136ee23106af65d8af5d9fc6c1d9d"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.654500 20031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:17:00.655248 20056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.655440 20031 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:00.655545 20031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "da35f343263f4b5c9197c3c9bad8017a"
format_stamp: "Formatted at 2026-08-11 07:17:00 on dist-test-slave-7f01"
server_key: "2d806b1b1d60e5034757f2cf891737d8"
server_key_iv: "076136ee23106af65d8af5d9fc6c1d9d"
server_key_version: "encryptionkey@0"
I20260811 07:17:00.655635 20031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:00.667443 20031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:00.669369 20031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:00.669545 20031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:00.669778 20031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:00.670104 20031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:00.670163 20031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.670203 20031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:00.670233 20031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:00.676437 20031 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:43799
I20260811 07:17:00.676487 20233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:43799 every 8 connection(s)
I20260811 07:17:00.676836 20031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:17:00.678898 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 20031
I20260811 07:17:00.679016 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:17:00.679195 9786 external_mini_cluster.cc:1428] Setting key 07aa4131374acf296d7dd8e5a33d1df2
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:00.686204 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.677591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:48045 (local address 127.9.142.190:33259)
0811 07:17:00.677654 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.677655 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.677854 (+ 199us) server_negotiation.cc:407] Connection header received
0811 07:17:00.678807 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.678809 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.678824 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.678912 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.679718 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.680396 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.681340 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.681525 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.681574 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.683615 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:00.683617 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:00.683617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:00.683623 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:00.685064 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.685423 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.685424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.685424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.685477 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.685696 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.685697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.685697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.685799 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:00.685848 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:00.686078 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 07:17:00.686140 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 07:17:00.686367 20239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.677541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33259 (local address 127.9.142.131:48045)
0811 07:17:00.677704 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:00.677744 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:00.678697 (+ 953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:00.678991 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:00.678995 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:00.679349 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:00.679588 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:00.679594 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.680477 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.680477 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:00.681266 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:00.681267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.681598 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.681599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:00.681701 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.682115 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:00.682123 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:00.683532 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:00.685136 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:00.685143 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:00.685144 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:00.685354 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:00.685544 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:00.685545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:00.685545 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:00.685641 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:00.685853 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:00.685857 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:00.685968 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 07:17:00.686049 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 07:17:00.686167 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260811 07:17:00.686822 20234 heartbeater.cc:347] Connected to a master server at 127.9.142.190:33259
I20260811 07:17:00.686936 20234 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:00.687136 20234 heartbeater.cc:511] Master 127.9.142.190:33259 requested a full tablet report, sending...
I20260811 07:17:00.687534 19466 ts_manager.cc:194] Registered new tserver with Master: da35f343263f4b5c9197c3c9bad8017a (127.9.142.131:43799)
I20260811 07:17:00.687986 19466 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:48045
I20260811 07:17:00.690917 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/test-admin.keytab.
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.708282 9786 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 07:17:00.709934 20245 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:00.709160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33216 (local address 127.9.142.129:34087)
0811 07:17:00.709320 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.709327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.709343 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:17:00.709370 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.709372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.709386 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.709455 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.709802 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33216: BlockingRecv error: recv got EOF from 127.0.0.1:33216 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
W20260811 07:17:00.710084 9786 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.711107 9786 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.712141 9786 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:17:00.720471 20245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.712671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33226 (local address 127.9.142.129:34087)
0811 07:17:00.712736 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.712738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.712755 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:17:00.712804 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.712805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.712815 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.712863 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.713329 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.714142 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.714860 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.715178 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.715236 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.717466 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:00.717474 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:00.717474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:00.717480 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:00.719294 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.719615 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.719618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.719618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.719676 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.719934 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.719935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.719935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.720066 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:00.720184 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:00.720240 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 07:17:00.720301 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 07:17:00.722196 20245 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:00.721671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33238 (local address 127.9.142.129:34087)
0811 07:17:00.721749 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.721750 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.721778 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:17:00.721830 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.721831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.721842 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.721888 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.722147 (+ 259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33238: BlockingRecv error: recv got EOF from 127.0.0.1:33238 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 07:17:00.722265 9786 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.723147 9786 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.724011 9786 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:17:00.730509 20245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.724507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33250 (local address 127.9.142.129:34087)
0811 07:17:00.724559 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.724561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.724604 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:17:00.724639 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.724639 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.724648 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.724691 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.725004 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.725446 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.726052 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.726230 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.726275 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.728201 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:00.728203 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:00.728203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:00.728208 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:00.729394 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.729690 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.729691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.729691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.729742 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.730019 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.730020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.730020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.730118 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:00.730194 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:00.730307 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 07:17:00.730400 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 07:17:00.732173 20245 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:00.731556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33260 (local address 127.9.142.129:34087)
0811 07:17:00.731621 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.731623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.731690 (+ 67us) server_negotiation.cc:407] Connection header received
0811 07:17:00.731799 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.731800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.731810 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.731866 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.732129 (+ 263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33260: BlockingRecv error: recv got EOF from 127.0.0.1:33260 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 07:17:00.732254 9786 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786432592145333-9786-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.733134 9786 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:00.734109 9786 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[19378](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:17:00.740811 20245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:00.734706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.9.142.129:34087)
0811 07:17:00.734764 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:00.734765 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:00.734800 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:17:00.734849 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:00.734850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:00.734857 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:00.734901 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:00.735238 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.735803 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.736422 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:00.736598 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:00.736649 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:00.738464 (+ 1815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:00.738465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:00.738465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:00.738471 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:00.739862 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.740171 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.740172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.740172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.740226 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:00.740405 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:00.740405 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:00.740405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:00.740490 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:00.740559 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:00.740622 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 07:17:00.740675 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:17:00.741430 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 19567
I20260811 07:17:00.750093 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 19786
I20260811 07:17:00.771003 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 20031
I20260811 07:17:00.780664 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 19405
2026-08-11T07:17:00Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2192 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[20269](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[20269](info): set up 2 sockets
Aug 11 07:17:00 dist-test-slave-7f01 krb5kdc[20269](info): commencing operation
krb5kdc: starting...
W20260811 07:17:02.054486 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:17:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:17:02Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.190.keytab.
Entry for principal oryx/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.190.keytab.
I20260811 07:17:02.174799 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:42895
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.190.keytab
--principal=oryx/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:42895
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:02.259374 20295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:02.259593 20295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:02.259630 20295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:02.260836 20295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:02.260903 20295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:02.260931 20295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:02.260962 20295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:02.260987 20295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:02.262437 20295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:42895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.190.keytab
--principal=oryx/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:42895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:02.262710 20295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:02.262939 20295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:02.268049 20308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.268167 20303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.268056 20304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:02.268392 20295 server_base.cc:1034] running on GCE node
I20260811 07:17:02.268646 20295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:02.268981 20295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:02.270155 20295 hybrid_clock.cc:648] HybridClock initialized: now 1786432622270140 us; error 50 us; skew 500 ppm
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:02.272753 20295 init.cc:377] Logged in from keytab as oryx/127.9.142.190@KRBTEST.COM (short username oryx)
I20260811 07:17:02.273237 20295 webserver.cc:460] Webserver started at http://127.9.142.190:34463/ using document root <none> and password file <none>
I20260811 07:17:02.273465 20295 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:02.273538 20295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:02.273693 20295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:02.274781 20295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "b73d966b51d0587f2a844de74c8047e7"
server_key_iv: "b2ec43018f85549b6aaab4e44bd62e7c"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.275173 20295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "b73d966b51d0587f2a844de74c8047e7"
server_key_iv: "b2ec43018f85549b6aaab4e44bd62e7c"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.276605 20295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:17:02.277432 20327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.277647 20295 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:02.277755 20295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "b73d966b51d0587f2a844de74c8047e7"
server_key_iv: "b2ec43018f85549b6aaab4e44bd62e7c"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.277828 20295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:02.289227 20295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:02.291591 20295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:02.291798 20295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:02.295919 20295 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:42895
I20260811 07:17:02.295975 20404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:42895 every 8 connection(s)
I20260811 07:17:02.296331 20295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:17:02.297323 20405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:02.299679 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 20295
I20260811 07:17:02.299818 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:17:02.299834 20405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: Bootstrap starting.
I20260811 07:17:02.300029 9786 external_mini_cluster.cc:1428] Setting key 9d17bc417bfa725500ae67cd66aa6dcd
I20260811 07:17:02.300556 20405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:02.300897 20405 log.cc:824] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:02.301627 20405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: No bootstrap required, opened a new log
I20260811 07:17:02.303462 20405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } }
I20260811 07:17:02.303624 20405 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:02.303674 20405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8823b7fd0d4052bc83b47b9bae3fdf, State: Initialized, Role: FOLLOWER
I20260811 07:17:02.303864 20405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } }
I20260811 07:17:02.303987 20405 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:17:02.304033 20405 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:17:02.304083 20405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:02.304670 20405 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } }
I20260811 07:17:02.304788 20405 leader_election.cc:302] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f8823b7fd0d4052bc83b47b9bae3fdf; no voters:
I20260811 07:17:02.304961 20405 leader_election.cc:288] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:17:02.305153 20412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:02.305246 20405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:02.305284 20412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 1 LEADER]: Becoming Leader. State: Replica: 3f8823b7fd0d4052bc83b47b9bae3fdf, State: Running, Role: LEADER
I20260811 07:17:02.305369 20412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } }
I20260811 07:17:02.305708 20412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f8823b7fd0d4052bc83b47b9bae3fdf. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } }
I20260811 07:17:02.305802 20412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:02.305722 20410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } }
I20260811 07:17:02.305840 20410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
W20260811 07:17:02.307387 20433 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:17:02.307869 20433 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:17:02.307982 20436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:17:02.308177 20436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:17:02.310511 20436 catalog_manager.cc:1347] Generated new cluster ID: 54274404cc7841ef8a22ac91dd2a23f1
I20260811 07:17:02.310572 20436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:17:02.311275 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:02.300587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55228 (local address 127.9.142.190:42895)
0811 07:17:02.300799 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:02.300808 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:02.300845 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:17:02.301497 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:02.301505 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:02.301553 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:02.301703 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:02.302357 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.303248 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.304147 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.304553 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.304635 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:02.307767 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:02.307772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:02.307773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:02.307786 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:02.309595 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:02.310014 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:02.310016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:02.310017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:02.310114 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:02.310341 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:02.310342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:02.310342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:02.310672 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:02.310834 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:02.310946 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 07:17:02.311084 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":110,"threads_started":1}
I20260811 07:17:02.338553 20436 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:17:02.339116 20436 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:17:02.354270 20436 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: Generated new TSK 0
I20260811 07:17:02.354480 20436 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab.
Entry for principal oryx/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab.
I20260811 07:17:02.390159 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42895
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab
--principal=oryx/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:02.486413 20443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:02.486609 20443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:02.486634 20443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:02.487720 20443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:02.487818 20443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:02.487847 20443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:17:02.489231 20443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab
--principal=oryx/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:02.489405 20443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:02.489579 20443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:02.494617 20456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.494571 20455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.494557 20460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:02.494879 20443 server_base.cc:1034] running on GCE node
I20260811 07:17:02.495079 20443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:02.495271 20443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:02.496409 20443 hybrid_clock.cc:648] HybridClock initialized: now 1786432622496397 us; error 29 us; skew 500 ppm
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:02.499230 20443 init.cc:377] Logged in from keytab as oryx/127.9.142.129@KRBTEST.COM (short username oryx)
I20260811 07:17:02.499668 20443 webserver.cc:460] Webserver started at http://127.9.142.129:44251/ using document root <none> and password file <none>
I20260811 07:17:02.499922 20443 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:02.499969 20443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:02.500116 20443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:02.501150 20443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "86748627d0a1448cb659320148462ddc"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "4c8be3607d0acd59eb21bd8926c41a86"
server_key_iv: "3f4626e04ba6c64201a86b648e2e4272"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.501510 20443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "86748627d0a1448cb659320148462ddc"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "4c8be3607d0acd59eb21bd8926c41a86"
server_key_iv: "3f4626e04ba6c64201a86b648e2e4272"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.502864 20443 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:17:02.503600 20479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.503811 20443 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:02.503917 20443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "86748627d0a1448cb659320148462ddc"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "4c8be3607d0acd59eb21bd8926c41a86"
server_key_iv: "3f4626e04ba6c64201a86b648e2e4272"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.504012 20443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:02.514964 20443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:02.516875 20443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:02.517047 20443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:02.517274 20443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:02.517602 20443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:02.517661 20443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.517693 20443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:02.517720 20443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.523799 20443 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:33611
I20260811 07:17:02.523829 20659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:33611 every 8 connection(s)
I20260811 07:17:02.524168 20443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:17:02.526124 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 20443
I20260811 07:17:02.526255 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:17:02.526471 9786 external_mini_cluster.cc:1428] Setting key 66a1c94a5720e773c10b97a30cee30ac
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:02.535027 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:02.524943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:38745 (local address 127.9.142.190:42895)
0811 07:17:02.525015 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:02.525017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:02.525219 (+ 202us) server_negotiation.cc:407] Connection header received
0811 07:17:02.525668 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:02.525669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:02.525679 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:02.525733 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:02.526945 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.527554 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.529068 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.529409 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.529488 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:02.531881 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:02.531883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:02.531884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:02.531892 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:02.533635 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:02.534044 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:02.534047 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:02.534047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:02.534116 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:02.534356 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:02.534357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:02.534357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:02.534504 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:02.534584 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:02.534815 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 07:17:02.534904 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 07:17:02.535056 20662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:02.524915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.129:38745)
0811 07:17:02.525107 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:02.525140 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:02.525590 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:02.525818 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:02.525821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:02.526647 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:02.526861 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:02.526867 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.527652 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.527653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:02.528977 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:02.528981 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.529501 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.529502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:02.529603 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:02.530125 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:02.530133 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:02.531778 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:02.533736 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:02.533743 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:02.533744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:02.533967 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:02.534191 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:02.534192 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:02.534192 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:02.534289 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:02.534576 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:02.534580 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:02.534688 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 07:17:02.534767 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 07:17:02.534882 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
I20260811 07:17:02.535559 20660 heartbeater.cc:347] Connected to a master server at 127.9.142.190:42895
I20260811 07:17:02.535650 20660 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:02.535861 20660 heartbeater.cc:511] Master 127.9.142.190:42895 requested a full tablet report, sending...
I20260811 07:17:02.536417 20356 ts_manager.cc:194] Registered new tserver with Master: 86748627d0a1448cb659320148462ddc (127.9.142.129:33611)
WARNING: no policy specified for oryx/127.9.142.130@KRBTEST.COM; defaulting to no policy
I20260811 07:17:02.536998 20356 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:38745
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab.
Entry for principal oryx/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab.
I20260811 07:17:02.554597 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42895
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab
--principal=oryx/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:02.637879 20668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:02.638119 20668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:02.638156 20668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:02.639294 20668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:02.639369 20668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:02.639415 20668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:17:02.640875 20668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab
--principal=oryx/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:02.641139 20668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:02.641366 20668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:02.646546 20676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.646556 20677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.646556 20681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:02.646871 20668 server_base.cc:1034] running on GCE node
I20260811 07:17:02.647043 20668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:02.647228 20668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:02.648367 20668 hybrid_clock.cc:648] HybridClock initialized: now 1786432622648352 us; error 31 us; skew 500 ppm
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:02.650964 20668 init.cc:377] Logged in from keytab as oryx/127.9.142.130@KRBTEST.COM (short username oryx)
I20260811 07:17:02.651427 20668 webserver.cc:460] Webserver started at http://127.9.142.130:37567/ using document root <none> and password file <none>
I20260811 07:17:02.651610 20668 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:02.651649 20668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:02.651801 20668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:02.652959 20668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "73f895fa3e67477a9ac1ff0df1c30d74"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "693222ce8ca9e5eabb02680bb9a024c7"
server_key_iv: "10f07230212da53ecaeaeed37f187ea4"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.653270 20668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "73f895fa3e67477a9ac1ff0df1c30d74"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "693222ce8ca9e5eabb02680bb9a024c7"
server_key_iv: "10f07230212da53ecaeaeed37f187ea4"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.654588 20668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:17:02.655337 20693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.655534 20668 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:17:02.655651 20668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "73f895fa3e67477a9ac1ff0df1c30d74"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "693222ce8ca9e5eabb02680bb9a024c7"
server_key_iv: "10f07230212da53ecaeaeed37f187ea4"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.655730 20668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:02.670522 20668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:02.672593 20668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:02.672755 20668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:02.672991 20668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:02.673300 20668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:02.673357 20668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.673390 20668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:02.673439 20668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.679627 20668 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:36411
I20260811 07:17:02.679675 20878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:36411 every 8 connection(s)
I20260811 07:17:02.680064 20668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:02.689061 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:02.680767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:42155 (local address 127.9.142.190:42895)
0811 07:17:02.680811 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:02.680814 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:02.681023 (+ 209us) server_negotiation.cc:407] Connection header received
0811 07:17:02.681661 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:02.681662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:02.681673 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:02.681732 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:02.682669 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.683152 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.684198 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.684381 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.684435 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:02.686517 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:02.686518 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:02.686518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:02.686525 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:02.687772 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:02.688160 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:02.688161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:02.688161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:02.688212 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:02.688497 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:02.688498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:02.688498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:02.688618 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:02.688670 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:02.688931 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 07:17:02.688994 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:17:02.689299 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:02.680730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.130:42155)
0811 07:17:02.680910 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:02.680951 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:02.681445 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:02.681820 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:02.681824 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:02.682397 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:02.682583 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:02.682588 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.683233 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.683234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:02.684124 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:02.684127 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.684456 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.684457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:02.684553 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:02.685001 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:02.685010 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:02.686422 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:02.687860 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:02.687867 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:02.687868 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:02.688095 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:02.688305 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:02.688306 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:02.688306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:02.688418 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:02.688684 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:02.688690 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:02.688806 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 07:17:02.688902 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:17:02.689021 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
I20260811 07:17:02.689297 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 20668
I20260811 07:17:02.689443 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:17:02.689642 9786 external_mini_cluster.cc:1428] Setting key 431808e4a683cfc091284221938a0eed
I20260811 07:17:02.689877 20880 heartbeater.cc:347] Connected to a master server at 127.9.142.190:42895
I20260811 07:17:02.689987 20880 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:02.690183 20880 heartbeater.cc:511] Master 127.9.142.190:42895 requested a full tablet report, sending...
I20260811 07:17:02.690670 20356 ts_manager.cc:194] Registered new tserver with Master: 73f895fa3e67477a9ac1ff0df1c30d74 (127.9.142.130:36411)
I20260811 07:17:02.691056 20356 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:42155
WARNING: no policy specified for oryx/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab.
Entry for principal oryx/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab.
I20260811 07:17:02.717067 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42895
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab
--principal=oryx/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:02.800961 20887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:02.801187 20887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:02.801224 20887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:02.802433 20887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:02.802505 20887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:02.802549 20887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:17:02.804061 20887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab
--principal=oryx/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:02.804322 20887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:02.804558 20887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:17:02.809983 20887 server_base.cc:1034] running on GCE node
W20260811 07:17:02.810019 20897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.809994 20895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.809970 20894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:02.810426 20887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:02.810681 20887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:02.811803 20887 hybrid_clock.cc:648] HybridClock initialized: now 1786432622811785 us; error 50 us; skew 500 ppm
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:02.814363 20887 init.cc:377] Logged in from keytab as oryx/127.9.142.131@KRBTEST.COM (short username oryx)
I20260811 07:17:02.814797 20887 webserver.cc:460] Webserver started at http://127.9.142.131:36647/ using document root <none> and password file <none>
I20260811 07:17:02.815025 20887 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:02.815097 20887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:02.815258 20887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:02.816341 20887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "840521325ce34ce186c304c939f5b744"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "fdf5f6cad4eb99c68d66af6f6a9946fc"
server_key_iv: "6ed12a06d01d25697aae8df243f9decc"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.816715 20887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "840521325ce34ce186c304c939f5b744"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "fdf5f6cad4eb99c68d66af6f6a9946fc"
server_key_iv: "6ed12a06d01d25697aae8df243f9decc"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.818038 20887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:17:02.818723 20911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.818902 20887 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:02.819012 20887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "840521325ce34ce186c304c939f5b744"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "fdf5f6cad4eb99c68d66af6f6a9946fc"
server_key_iv: "6ed12a06d01d25697aae8df243f9decc"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.819087 20887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:02.828903 20887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:02.831079 20887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:02.831229 20887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:02.831444 20887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:02.831851 20887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:02.831910 20887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.831951 20887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:02.831980 20887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.838104 20887 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:45575
I20260811 07:17:02.838161 21098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:45575 every 8 connection(s)
I20260811 07:17:02.838454 20887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:17:02.841961 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 20887
I20260811 07:17:02.842070 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:17:02.842252 9786 external_mini_cluster.cc:1428] Setting key d7dfdce0fec1b3eca74c854540b36cd6
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:02.848050 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:02.839140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:39307 (local address 127.9.142.190:42895)
0811 07:17:02.839203 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:02.839205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:02.839380 (+ 175us) server_negotiation.cc:407] Connection header received
0811 07:17:02.839847 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:02.839848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:02.839857 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:02.839913 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:02.840765 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.841254 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.842546 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.842871 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.842954 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:02.845104 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:02.845105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:02.845106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:02.845112 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:02.846498 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:02.846975 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:02.846976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:02.846976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:02.847037 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:02.847348 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:02.847349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:02.847350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:02.847488 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:02.847553 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:02.847913 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 07:17:02.847984 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 07:17:02.848237 21102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:02.839096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.131:39307)
0811 07:17:02.839245 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:02.839284 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:02.839763 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:02.839959 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:02.839962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:02.840518 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:02.840694 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:02.840698 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.841334 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.841335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:02.842401 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:02.842404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:02.842974 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:02.842975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:02.843109 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:02.843544 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:02.843552 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:02.845016 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:02.846594 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:02.846600 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:02.846602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:02.846884 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:02.847123 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:02.847124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:02.847124 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:02.847237 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:02.847562 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:02.847568 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:02.847679 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 07:17:02.847879 (+ 200us) client_negotiation.cc:240] Negotiation successful
0811 07:17:02.848007 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260811 07:17:02.848727 21099 heartbeater.cc:347] Connected to a master server at 127.9.142.190:42895
I20260811 07:17:02.848847 21099 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:02.848997 21099 heartbeater.cc:511] Master 127.9.142.190:42895 requested a full tablet report, sending...
I20260811 07:17:02.849387 20356 ts_manager.cc:194] Registered new tserver with Master: 840521325ce34ce186c304c939f5b744 (127.9.142.131:45575)
I20260811 07:17:02.849782 20356 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:39307
I20260811 07:17:02.854209 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.142.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.189.keytab.
Entry for principal oryx/127.9.142.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.189.keytab.
I20260811 07:17:02.886659 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.189:46257
--webserver_interface=127.9.142.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.189.keytab
--principal=oryx/127.9.142.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:42895,127.9.142.189:46257
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:02.975636 21107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:02.975848 21107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:02.975871 21107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:02.976917 21107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:02.976949 21107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:02.976963 21107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:02.976975 21107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:02.976987 21107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:02.978351 21107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:42895,127.9.142.189:46257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.189.keytab
--principal=oryx/127.9.142.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.189:46257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.142.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
W20260811 07:17:02.978446 21107 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.9.142.190:42895,127.9.142.189:46257'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 07:17:02.978549 21107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:02.978705 21107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:02.983515 21121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.983529 21118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:02.983532 21119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:02.983877 21107 server_base.cc:1034] running on GCE node
I20260811 07:17:02.984169 21107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:02.984445 21107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:02.985611 21107 hybrid_clock.cc:648] HybridClock initialized: now 1786432622985592 us; error 37 us; skew 500 ppm
Aug 11 07:17:02 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:02.988091 21107 init.cc:377] Logged in from keytab as oryx/127.9.142.189@KRBTEST.COM (short username oryx)
I20260811 07:17:02.988562 21107 webserver.cc:460] Webserver started at http://127.9.142.189:36487/ using document root <none> and password file <none>
I20260811 07:17:02.988786 21107 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:02.988854 21107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:02.989020 21107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:02.990023 21107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data/instance:
uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "3d177077404fcbf6b523d640a24d52d9"
server_key_iv: "f7180a2b7c253aca5ef72681c33ee7e3"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.990387 21107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal/instance:
uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "3d177077404fcbf6b523d640a24d52d9"
server_key_iv: "f7180a2b7c253aca5ef72681c33ee7e3"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.991817 21107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 07:17:02.992640 21131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:02.992820 21107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:02.992940 21107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal
uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "3d177077404fcbf6b523d640a24d52d9"
server_key_iv: "f7180a2b7c253aca5ef72681c33ee7e3"
server_key_version: "encryptionkey@0"
I20260811 07:17:02.993034 21107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:03.000226 21107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:03.001958 21107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:03.002115 21107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:03.006598 21107 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.189:46257
I20260811 07:17:03.006629 21219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.189:46257 every 8 connection(s)
I20260811 07:17:03.006994 21107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
I20260811 07:17:03.008117 21222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:03.009596 21222 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:17:03.012444 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 21107
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.189@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.142.189@KRBTEST.COM
I20260811 07:17:03.019008 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.010195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55236 (local address 127.9.142.190:42895)
0811 07:17:03.010238 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.010240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.010475 (+ 235us) server_negotiation.cc:407] Connection header received
0811 07:17:03.010978 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.010980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.011006 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.011056 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.011645 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.012215 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.013506 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.013693 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.013747 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.016016 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.016017 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.016018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.016027 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.017475 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.017914 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.017915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.017916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.017982 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.018240 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.018241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.018241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.018458 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.018545 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.018802 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.018895 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:17:03.019351 21224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.010160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55236)
0811 07:17:03.010359 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.010392 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.010864 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.011132 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.011136 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.011367 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.011550 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.011554 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.012324 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.012325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.013423 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.013426 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.013779 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.013781 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.013939 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.014439 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.014448 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.015897 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.017566 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.017576 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.017579 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.017836 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.018059 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.018060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.018060 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.018157 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.018551 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.018557 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.018662 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.018762 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.018969 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":98,"threads_started":1}
I20260811 07:17:03.020047 21222 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:17:03.021903 21228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.012992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53430 (local address 127.9.142.189:46257)
0811 07:17:03.013137 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.013140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.013224 (+ 84us) server_negotiation.cc:407] Connection header received
0811 07:17:03.013274 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.013276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.013297 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.013362 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.014098 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.014768 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.015623 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.016013 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.016091 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.018745 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.018753 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.018754 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.018761 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.020671 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.021047 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.021049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.021050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.021101 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.021301 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.021302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.021302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.021420 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.021572 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.021626 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.021712 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":64,"threads_started":1}
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.189@KRBTEST.COM for oryx/127.9.142.189@KRBTEST.COM
I20260811 07:17:03.027115 21224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.020310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.0.0.1:53440)
0811 07:17:03.020492 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.020501 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.020555 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.020676 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.020676 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.020812 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.020856 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.020858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.021704 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.021705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.022396 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.022399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.022774 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.022775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.022834 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.023197 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.023201 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.024318 (+ 1117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.026354 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.026355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.026355 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.026510 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.026678 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.026678 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.026679 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.026728 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.026909 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.026909 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.026941 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.026989 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.027059 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
I20260811 07:17:03.027242 21229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.020365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53440 (local address 127.9.142.189:46257)
0811 07:17:03.020507 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.020509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.020539 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:17:03.020611 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.020612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.020619 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.020671 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.020925 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.021629 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.022498 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.022712 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.022760 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.024391 (+ 1631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.024392 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.024392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.024398 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.026287 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.026570 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.026571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.026571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.026621 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.026779 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.026779 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.026779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.026861 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.026905 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.027005 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.027104 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
I20260811 07:17:03.028465 21222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Bootstrap starting.
I20260811 07:17:03.029083 21222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:03.029363 21222 log.cc:824] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:03.030014 21222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: No bootstrap required, opened a new log
I20260811 07:17:03.031378 21222 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } }
I20260811 07:17:03.031520 21222 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:03.031581 21222 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a1a4cc9ff64abd8a9e7753a34096c5, State: Initialized, Role: FOLLOWER
I20260811 07:17:03.031725 21222 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } }
I20260811 07:17:03.032049 21222 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:03.032024 21233 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } } }
I20260811 07:17:03.032141 21233 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:17:03.033730 21252 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:17:03.033787 21252 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:17:03.035291 21107 master_runner.cc:428] Detected that this master b3a1a4cc9ff64abd8a9e7753a34096c5 is joining an existing cluster
I20260811 07:17:03.035346 21107 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.142.189:46257
I20260811 07:17:03.043264 21229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.036574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53452 (local address 127.9.142.189:46257)
0811 07:17:03.036623 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.036625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.036795 (+ 170us) server_negotiation.cc:407] Connection header received
0811 07:17:03.036840 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.036841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.036851 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.036906 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.037280 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.037997 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.038941 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.039150 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.039242 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.040449 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.040450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.040451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.040457 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.042035 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.042447 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.042448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.042448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.042506 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.042687 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.042688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.042688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.042806 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.042903 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.043047 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.043177 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":32}
I20260811 07:17:03.043318 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.036641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55250 (local address 127.9.142.190:42895)
0811 07:17:03.036695 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.036697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.036706 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:03.036730 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.036731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.036743 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.036796 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.037299 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.037767 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.038802 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.039137 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.039213 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.040387 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.040389 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.040389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.040396 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.042058 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.042509 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.042510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.042510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.042564 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.042742 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.042744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.042744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.042877 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.042943 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.043148 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.043227 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 07:17:03.043604 21262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.036415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55250)
0811 07:17:03.036571 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.036581 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.036636 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.036840 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.036842 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.037098 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.037196 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.037198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.037851 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.037852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.038710 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.038712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.039251 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.039252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.039334 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.039772 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.039777 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.040291 (+ 514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.042157 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.042158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.042158 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.042439 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.042614 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.042615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.042616 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.042686 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.042972 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.042973 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.043024 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.043398 (+ 374us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.043501 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260811 07:17:03.043787 21263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.036425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.0.0.1:53452)
0811 07:17:03.036714 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.036723 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.036784 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.036924 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.036925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.037139 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.037196 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.037198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.038079 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.038080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.038848 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.038850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.039461 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.039461 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.039499 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.039970 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.039975 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.040376 (+ 401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.042137 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.042138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.042138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.042363 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.042562 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.042562 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.042563 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.042627 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.042926 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.042926 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.042963 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.043024 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.043124 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":88,"threads_started":1}
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.190@KRBTEST.COM for oryx/127.9.142.189@KRBTEST.COM
I20260811 07:17:03.053001 21265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.045747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.0.0.1:53464)
0811 07:17:03.045886 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.045926 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.046014 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.046230 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.046237 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.046502 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.046544 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.046546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.047409 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.047410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.048037 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.048039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.048475 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.048475 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.048524 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.048971 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.048975 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.050401 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.052054 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.052061 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.052063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.052251 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.052451 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.052452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.052452 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.052506 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.052751 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.052757 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.052795 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.052855 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.052937 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":87,"threads_started":1}
I20260811 07:17:03.053069 21229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.045824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53464 (local address 127.9.142.189:46257)
0811 07:17:03.045862 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.045864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.045994 (+ 130us) server_negotiation.cc:407] Connection header received
0811 07:17:03.046106 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.046107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.046120 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.046176 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.046623 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.047328 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.048111 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.048404 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.048474 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.050494 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.050495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.050496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.050503 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.051957 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.052321 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.052322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.052322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.052384 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.052567 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.052567 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.052568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.052689 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.052756 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.052899 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.052974 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:17:03.053831 20356 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.142.189:46257: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5"
member_type: NON_VOTER
last_known_addr {
host: "127.9.142.189"
port: 46257
}
attrs {
promote: true
}
}
dest_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf"
cas_config_opid_index: -1
I20260811 07:17:03.054148 20356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } }
I20260811 07:17:03.054642 21266 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER b3a1a4cc9ff64abd8a9e7753a34096c5 (127.9.142.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } } }
I20260811 07:17:03.054965 21174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:03.055543 21266 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.142.189:46257
I20260811 07:17:03.055683 21268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } } }
I20260811 07:17:03.055827 21268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:03.055855 21107 master.cc:537] Master@127.9.142.189:46257 shutting down...
I20260811 07:17:03.055915 21174 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Refusing update from remote peer 3f8823b7fd0d4052bc83b47b9bae3fdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 07:17:03.056254 21268 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:17:03.056998 20329 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260811 07:17:03.058677 21107 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:03.058780 21107 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:03.058835 21107 tablet_replica.cc:330] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: stopping tablet replica
I20260811 07:17:03.064126 21265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.064017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.0.0.1:53470)
0811 07:17:03.064066 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.064101 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:46257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 07:17:03.064224 20329 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf -> Peer b3a1a4cc9ff64abd8a9e7753a34096c5 (127.9.142.189:46257): Couldn't send request to peer b3a1a4cc9ff64abd8a9e7753a34096c5. Status: Network error: Client connection negotiation failed: client connection to 127.9.142.189:46257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 07:17:03.071451 21107 master.cc:552] Master@127.9.142.189:46257 shutdown complete.
I20260811 07:17:03.071491 21107 master_runner.cc:305] Clearing existing system tablet
I20260811 07:17:03.071642 21107 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:03.071681 21107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:03.072340 21107 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.072916 21277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.073045 21107 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:03.073104 21107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:17:03.073149 21107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal
uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "3d177077404fcbf6b523d640a24d52d9"
server_key_iv: "f7180a2b7c253aca5ef72681c33ee7e3"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.073812 21107 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:03.075143 21107 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 07:17:03.075205 21107 log.cc:1196] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 07:17:03.075404 21107 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Deleting consensus metadata
I20260811 07:17:03.075532 21107 master_runner.cc:315] Copying system tablet from 127.9.142.190:42895
I20260811 07:17:03.076201 21107 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.142.190:42895
I20260811 07:17:03.083019 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.076556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55260 (local address 127.9.142.190:42895)
0811 07:17:03.076601 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.076603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.076716 (+ 113us) server_negotiation.cc:407] Connection header received
0811 07:17:03.076780 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.076780 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.076789 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.076836 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.077483 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.077975 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.079031 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.079208 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.079262 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.080329 (+ 1067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.080330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.080331 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.080337 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.081958 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.082336 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.082337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.082337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.082392 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.082587 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.082588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.082588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.082684 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.082731 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.082903 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.082960 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:17:03.083197 21286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.076478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55260)
0811 07:17:03.076642 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.076652 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.076717 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.076843 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.076844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.077046 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.077401 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.077404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.078050 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.078051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.078948 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.078950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.079283 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.079284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.079362 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.079852 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.079857 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.080242 (+ 385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.082033 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.082034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.082034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.082259 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.082453 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.082454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.082454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.082521 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.082742 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.082743 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.082790 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.082870 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.082973 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":80,"threads_started":1}
I20260811 07:17:03.083518 20379 tablet_copy_service.cc:140] P 3f8823b7fd0d4052bc83b47b9bae3fdf: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b3a1a4cc9ff64abd8a9e7753a34096c5 ({username='oryx', principal='oryx/127.9.142.189@KRBTEST.COM'} at 127.0.0.1:55260)
I20260811 07:17:03.083626 20379 tablet_copy_service.cc:161] P 3f8823b7fd0d4052bc83b47b9bae3fdf: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b3a1a4cc9ff64abd8a9e7753a34096c5 at {username='oryx', principal='oryx/127.9.142.189@KRBTEST.COM'} at 127.0.0.1:55260: session id = b3a1a4cc9ff64abd8a9e7753a34096c5-00000000000000000000000000000000
I20260811 07:17:03.084358 20379 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 07:17:03.084965 21107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 07:17:03.085839 21107 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: tablet copy: Starting download of 0 data blocks...
I20260811 07:17:03.085999 21107 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: tablet copy: Starting download of 1 WAL segments...
I20260811 07:17:03.086933 21107 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 07:17:03.087687 20379 tablet_copy_service.cc:342] P 3f8823b7fd0d4052bc83b47b9bae3fdf: Request end of tablet copy session b3a1a4cc9ff64abd8a9e7753a34096c5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.142.189@KRBTEST.COM'} at 127.0.0.1:55260
I20260811 07:17:03.087778 20379 tablet_copy_service.cc:433] P 3f8823b7fd0d4052bc83b47b9bae3fdf: ending tablet copy session b3a1a4cc9ff64abd8a9e7753a34096c5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b3a1a4cc9ff64abd8a9e7753a34096c5
I20260811 07:17:03.090102 21107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:03.091291 21288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.091212 21287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.091387 21290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:03.091559 21107 server_base.cc:1034] running on GCE node
I20260811 07:17:03.091656 21107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:03.091804 21107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:03.092928 21107 hybrid_clock.cc:648] HybridClock initialized: now 1786432623092917 us; error 25 us; skew 500 ppm
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:03.094281 21107 init.cc:377] Logged in from keytab as oryx/127.9.142.189@KRBTEST.COM (short username oryx)
I20260811 07:17:03.094538 21107 webserver.cc:460] Webserver started at http://127.9.142.189:37499/ using document root <none> and password file <none>
I20260811 07:17:03.094655 21107 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:03.094693 21107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:03.095366 21107 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:03.095985 21307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.096127 21107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:03.096184 21107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal
uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "3d177077404fcbf6b523d640a24d52d9"
server_key_iv: "f7180a2b7c253aca5ef72681c33ee7e3"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.096238 21107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:03.106386 21107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:03.108031 21107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:03.111259 21107 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.189:46257
I20260811 07:17:03.111691 21397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.189:46257 every 8 connection(s)
I20260811 07:17:03.111696 21107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
I20260811 07:17:03.112505 21398 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:17:03.112907 21398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Bootstrap starting.
I20260811 07:17:03.115105 21398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:17:03.115347 21398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Bootstrap complete.
I20260811 07:17:03.115571 21398 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } }
I20260811 07:17:03.115640 21398 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b3a1a4cc9ff64abd8a9e7753a34096c5, State: Initialized, Role: LEARNER
I20260811 07:17:03.115669 21398 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } }
I20260811 07:17:03.115872 21398 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:03.115892 21405 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } } }
I20260811 07:17:03.115996 21405 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:17:03.117352 21422 catalog_manager.cc:1259] Loaded cluster ID: 54274404cc7841ef8a22ac91dd2a23f1
I20260811 07:17:03.117419 21422 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: loading cluster ID for follower catalog manager: success
I20260811 07:17:03.118314 21422 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: acquiring CA information for follower catalog manager: success
I20260811 07:17:03.118597 21422 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:17:03.130360 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.123413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53486 (local address 127.9.142.189:46257)
0811 07:17:03.123545 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.123547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.123558 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:17:03.123584 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.123585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.123597 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.123685 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.124266 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.125304 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.126009 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.126319 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.126411 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.127597 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.127598 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.127599 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.127606 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.129207 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.129541 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.129542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.129543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.129611 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.129806 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.129807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.129807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.129948 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.130054 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.130136 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.130220 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
WARNING: no policy specified for oryx/127.9.142.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.188.keytab.
Entry for principal oryx/127.9.142.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.188.keytab.
I20260811 07:17:03.158702 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.188:36097
--webserver_interface=127.9.142.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.188.keytab
--principal=oryx/127.9.142.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:42895,127.9.142.189:46257,127.9.142.188:36097
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:03.246292 21434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:03.246547 21434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:03.246585 21434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:03.247860 21434 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:03.247923 21434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:03.247947 21434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:03.247974 21434 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:03.248006 21434 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:03.249500 21434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:42895,127.9.142.189:46257,127.9.142.188:36097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.188.keytab
--principal=oryx/127.9.142.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.188:36097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.142.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:03.249778 21434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:03.250005 21434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:03.255050 21445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.255064 21448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.255064 21450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:03.255291 21434 server_base.cc:1034] running on GCE node
I20260811 07:17:03.255589 21434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:03.255940 21434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:03.257089 21434 hybrid_clock.cc:648] HybridClock initialized: now 1786432623257076 us; error 28 us; skew 500 ppm
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:03.259999 21434 init.cc:377] Logged in from keytab as oryx/127.9.142.188@KRBTEST.COM (short username oryx)
I20260811 07:17:03.260427 21434 webserver.cc:460] Webserver started at http://127.9.142.188:36225/ using document root <none> and password file <none>
I20260811 07:17:03.260656 21434 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:03.260702 21434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:03.260852 21434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:03.261904 21434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data/instance:
uuid: "91cd75cf10964e43badda4d74723ed86"
format_stamp: "Formatted at 2026-08-11 07:17:03 on dist-test-slave-7f01"
server_key: "98107e11eb5550760c4203eb64f44a64"
server_key_iv: "3a05bc65a5374523d86def683edb3f7c"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.262212 21434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal/instance:
uuid: "91cd75cf10964e43badda4d74723ed86"
format_stamp: "Formatted at 2026-08-11 07:17:03 on dist-test-slave-7f01"
server_key: "98107e11eb5550760c4203eb64f44a64"
server_key_iv: "3a05bc65a5374523d86def683edb3f7c"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.263615 21434 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:17:03.264506 21465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.264714 21434 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:03.264827 21434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal
uuid: "91cd75cf10964e43badda4d74723ed86"
format_stamp: "Formatted at 2026-08-11 07:17:03 on dist-test-slave-7f01"
server_key: "98107e11eb5550760c4203eb64f44a64"
server_key_iv: "3a05bc65a5374523d86def683edb3f7c"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.264889 21434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:03.290688 21434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:03.293238 21434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:03.293356 21434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:03.298417 21434 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.188:36097
I20260811 07:17:03.298496 21546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.188:36097 every 8 connection(s)
I20260811 07:17:03.298895 21434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
I20260811 07:17:03.300016 21547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:03.301676 21547 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:17:03.304520 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 21434
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.188@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.142.188@KRBTEST.COM
I20260811 07:17:03.312839 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.302487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55274 (local address 127.9.142.190:42895)
0811 07:17:03.302583 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.302586 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.302746 (+ 160us) server_negotiation.cc:407] Connection header received
0811 07:17:03.303258 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.303260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.303272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.303337 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.304045 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.304753 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.306459 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.306790 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.306890 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.309616 (+ 2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.309617 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.309617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.309624 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.311238 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.311733 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.311770 (+ 37us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.311770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.311843 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.312191 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.312197 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.312197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.312313 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.312370 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.312701 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.312773 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:17:03.313125 21551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.302393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55274)
0811 07:17:03.302630 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.302665 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.303150 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.303407 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.303410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.303659 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.303950 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.303955 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.304901 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.304903 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.306355 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.306359 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.306940 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.306941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.307068 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.307670 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.307678 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.309514 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.311316 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.311323 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.311325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.311652 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.311944 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.311945 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.311945 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.312110 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.312386 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.312391 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.312555 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.312678 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.312868 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":139,"threads_started":1}
I20260811 07:17:03.313786 21547 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:17:03.314376 21554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.305168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54960 (local address 127.9.142.188:36097)
0811 07:17:03.305339 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.305382 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.305403 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:17:03.305431 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.305434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.305455 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.305534 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.306346 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.307308 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.308257 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.308724 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.308801 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.311163 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.311172 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.311172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.311179 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.312973 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.313418 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.313421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.313421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.313485 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.313693 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.313694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.313694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.313853 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.314063 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.314160 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.314247 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":111,"threads_started":1}
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.188@KRBTEST.COM for oryx/127.9.142.189@KRBTEST.COM
I20260811 07:17:03.320423 21551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.314038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.0.0.1:53494)
0811 07:17:03.314081 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.314090 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.314124 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.314306 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.314307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.314452 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.314499 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.314501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.315315 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.315315 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.315880 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.315882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.316278 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.316279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.316332 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.316635 (+ 303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.316639 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.317893 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.319461 (+ 1568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.319462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.319463 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.319617 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.319854 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.319854 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.319855 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.319930 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.320202 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.320203 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.320240 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.320293 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.320364 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 07:17:03.320467 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.314128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53494 (local address 127.9.142.189:46257)
0811 07:17:03.314174 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.314176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.314183 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:17:03.314213 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.314214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.314230 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.314288 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.314609 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.315236 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.315949 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.316154 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.316257 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.317974 (+ 1717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.317975 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.317975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.317982 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.319392 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.319681 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.319682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.319682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.319776 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.320027 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.320028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.320028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.320143 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.320198 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.320330 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.320401 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:17:03.320905 21547 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.188@KRBTEST.COM for oryx/127.9.142.188@KRBTEST.COM
I20260811 07:17:03.326845 21551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.321176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36097 (local address 127.0.0.1:54970)
0811 07:17:03.321225 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.321235 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.321273 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.321432 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.321433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.321555 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.321580 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.321581 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.322194 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.322195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.322688 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.322690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.323064 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.323065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.323114 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.323419 (+ 305us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.323423 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.324486 (+ 1063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.325797 (+ 1311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.325798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.325799 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.325959 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.326181 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.326181 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.326182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.326236 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.326490 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.326491 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.326529 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.326614 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.326708 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 07:17:03.326897 21554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.321242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54970 (local address 127.9.142.188:36097)
0811 07:17:03.321278 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.321280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.321288 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:03.321326 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.321327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.321336 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.321389 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.321654 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.322105 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.322765 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.322980 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.323064 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.324569 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.324570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.324571 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.324577 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.325712 (+ 1135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.326054 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.326055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.326056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.326112 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.326308 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.326309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.326309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.326413 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.326485 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.326636 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.326759 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":21}
I20260811 07:17:03.328369 21547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: Bootstrap starting.
I20260811 07:17:03.329175 21547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:03.329432 21547 log.cc:824] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:03.330143 21547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: No bootstrap required, opened a new log
I20260811 07:17:03.331571 21547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } }
I20260811 07:17:03.331693 21547 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:03.331717 21547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91cd75cf10964e43badda4d74723ed86, State: Initialized, Role: FOLLOWER
I20260811 07:17:03.331873 21547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } }
I20260811 07:17:03.332175 21547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:03.332175 21556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } } }
I20260811 07:17:03.332314 21556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:17:03.333966 21577 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:17:03.334031 21577 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:17:03.336414 21434 master_runner.cc:428] Detected that this master 91cd75cf10964e43badda4d74723ed86 is joining an existing cluster
I20260811 07:17:03.336458 21434 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.142.188:36097
I20260811 07:17:03.344609 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.337560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55286 (local address 127.9.142.190:42895)
0811 07:17:03.337709 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.337711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.337784 (+ 73us) server_negotiation.cc:407] Connection header received
0811 07:17:03.337854 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.337855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.337868 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.337925 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.338294 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.338955 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.339831 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.340043 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.340119 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.341114 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.341116 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.341116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.341124 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.342820 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.343699 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.343700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.343701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.343792 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.344017 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.344018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.344018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.344159 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.344208 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.344434 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.344509 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260811 07:17:03.344640 21587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.337493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55286)
0811 07:17:03.337706 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.337715 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.337797 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.337935 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.337935 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.338111 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.338198 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.338201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.339075 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.339076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.339722 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.339724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.340139 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.340141 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.340205 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.340625 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.340630 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.341022 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.343406 (+ 2384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.343407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.343407 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.343619 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.343870 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.343871 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.343871 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.343937 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.344260 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.344260 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.344303 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.344396 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.344508 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":339,"threads_started":1}
I20260811 07:17:03.344937 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.337563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53508 (local address 127.9.142.189:46257)
0811 07:17:03.337605 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.337607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.338085 (+ 478us) server_negotiation.cc:407] Connection header received
0811 07:17:03.338117 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.338118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.338130 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.338198 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.338588 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.339263 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.340404 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.340692 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.340791 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.341769 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.341771 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.341771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.341779 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.343327 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.343819 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.343820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.343820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.343878 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.344146 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.344147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.344148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.344278 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.344347 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.344543 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.344631 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:17:03.345491 21590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.337494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.0.0.1:53508)
0811 07:17:03.338009 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.338019 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.338074 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.338228 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.338229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.338428 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.338498 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.338500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.339346 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.339348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.340284 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.340288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.340795 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.340796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.340867 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.341286 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.341292 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.341663 (+ 371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.343412 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.343414 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.343414 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.343713 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.343953 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.343954 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.343955 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.344048 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.344356 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.344357 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.344405 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.345057 (+ 652us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.345199 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":64,"thread_start_us":81,"threads_started":1}
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432622, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.190@KRBTEST.COM for oryx/127.9.142.188@KRBTEST.COM
I20260811 07:17:03.363552 21587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.343981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36097 (local address 127.0.0.1:54980)
0811 07:17:03.344798 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.344808 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.344869 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.345018 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.345019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.345180 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.345234 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.345236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.346105 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.346105 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.346904 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.346907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.347377 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.347378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.347428 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.360234 (+ 12806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.360238 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.360679 (+ 441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.362396 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.362398 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.362398 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.362617 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.362855 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.362855 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.362856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.362931 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.363225 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.363226 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.363269 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.363338 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.363446 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"thread_start_us":93,"threads_started":1}
I20260811 07:17:03.363827 21265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.347073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36097 (local address 127.0.0.1:54984)
0811 07:17:03.347424 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.347435 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.347480 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.347637 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.347638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.347835 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.347883 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.347885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.348601 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.348603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.349428 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.349430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.349774 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.349775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.349845 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.350180 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.350185 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.351665 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.362411 (+ 10746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.362412 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.362412 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.362618 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.363068 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.363070 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.363070 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.363130 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.363448 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.363449 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.363495 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.363571 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.363694 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333}
I20260811 07:17:03.363826 21592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.347105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54984 (local address 127.9.142.188:36097)
0811 07:17:03.347233 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.347234 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.347487 (+ 253us) server_negotiation.cc:407] Connection header received
0811 07:17:03.347554 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.347554 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.347563 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.347619 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.347977 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.348514 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.349509 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.349697 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.349747 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.351802 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.351803 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.351804 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.351817 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.361728 (+ 9911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.362869 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.362870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.362870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.362974 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.363203 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.363204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.363205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.363345 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.363446 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.363612 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.363700 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":67,"threads_started":1}
I20260811 07:17:03.364359 21554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.337815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54980 (local address 127.9.142.188:36097)
0811 07:17:03.337854 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.337856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.344844 (+ 6988us) server_negotiation.cc:407] Connection header received
0811 07:17:03.344935 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.344936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.344945 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.344969 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.345310 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.346004 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.347001 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.347301 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.347371 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.360784 (+ 13413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.360785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.360785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.360791 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.362290 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.362707 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.362708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.362708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.362777 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.363003 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.363004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.363004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.363139 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.363203 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.363375 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.364268 (+ 893us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":805,"server-negotiator.queue_time_us":22}
I20260811 07:17:03.364375 20356 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.142.188:36097: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "91cd75cf10964e43badda4d74723ed86"
member_type: NON_VOTER
last_known_addr {
host: "127.9.142.188"
port: 36097
}
attrs {
promote: true
}
}
dest_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf"
cas_config_opid_index: 5
I20260811 07:17:03.364645 20356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } }
I20260811 07:17:03.365084 21266 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 91cd75cf10964e43badda4d74723ed86 (127.9.142.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.365393 21514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:03.366164 21266 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.142.188:36097
I20260811 07:17:03.366233 21266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.366289 21266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:03.366359 21514 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 FOLLOWER]: Refusing update from remote peer 3f8823b7fd0d4052bc83b47b9bae3fdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 07:17:03.366578 21434 master.cc:537] Master@127.9.142.188:36097 shutting down...
I20260811 07:17:03.366843 21268 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:03.367041 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 20443
W20260811 07:17:03.377626 20332 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf -> Peer 91cd75cf10964e43badda4d74723ed86 (127.9.142.188:36097): Couldn't send request to peer 91cd75cf10964e43badda4d74723ed86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:17:03.387831 21265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.365086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.0.0.1:53524)
0811 07:17:03.365251 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.365263 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.365308 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.365535 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.365536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.365538 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:03.365571 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.365572 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.384811 (+ 19239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.384813 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.386096 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.386101 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.387402 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.387404 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.387495 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.387532 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.387601 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.387657 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150}
I20260811 07:17:03.388168 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.365144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53524 (local address 127.9.142.189:46257)
0811 07:17:03.365182 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.365184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.365360 (+ 176us) server_negotiation.cc:407] Connection header received
0811 07:17:03.365398 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.365400 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.365425 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.365481 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:03.365637 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.366330 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.386244 (+ 19914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.387141 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.387231 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.387343 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.388012 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.388068 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:17:03.392513 21360 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 LEARNER]: Refusing update from remote peer 3f8823b7fd0d4052bc83b47b9bae3fdf: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 07:17:03.392757 21268 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 07:17:03.393401 21360 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 91cd75cf10964e43badda4d74723ed86 (127.9.142.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.394771 21405 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f8823b7fd0d4052bc83b47b9bae3fdf. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.394869 21405 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:17:03.394904 21405 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: NON_VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: true } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.394944 21405 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:17:03.395371 21268 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: attempting to promote NON_VOTER b3a1a4cc9ff64abd8a9e7753a34096c5 to VOTER
I20260811 07:17:03.395648 21268 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } }
I20260811 07:17:03.396781 21434 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:03.396903 21434 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:03.396968 21434 tablet_replica.cc:330] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: stopping tablet replica
W20260811 07:17:03.397102 20332 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf -> Peer 91cd75cf10964e43badda4d74723ed86 (127.9.142.188:36097): Couldn't send request to peer 91cd75cf10964e43badda4d74723ed86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:17:03.397688 21360 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 LEARNER]: Refusing update from remote peer 3f8823b7fd0d4052bc83b47b9bae3fdf: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 07:17:03.397893 21598 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 07:17:03.399195 21266 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b3a1a4cc9ff64abd8a9e7753a34096c5 (127.9.142.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.399962 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:33611
--local_ip_for_outbound_sockets=127.9.142.129
--tserver_master_addrs=127.9.142.190:42895
--webserver_port=44251
--webserver_interface=127.9.142.129
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab
--principal=oryx/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.142.190:42895,127.9.142.189:46257
--tserver_master_addrs=127.9.142.190:42895,127.9.142.189:46257,127.9.142.188:36097 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:17:03.400048 21360 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b3a1a4cc9ff64abd8a9e7753a34096c5 (127.9.142.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.400297 21266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.400403 21266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:03.400465 21266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.400527 21266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:03.400939 21596 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.401036 21596 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:17:03.410387 21434 master.cc:552] Master@127.9.142.188:36097 shutdown complete.
I20260811 07:17:03.410444 21434 master_runner.cc:305] Clearing existing system tablet
I20260811 07:17:03.410583 21434 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:03.410642 21434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:03.411397 21434 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:03.411971 21601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.412132 21434 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:03.412197 21434 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.412222 21434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal
uuid: "91cd75cf10964e43badda4d74723ed86"
format_stamp: "Formatted at 2026-08-11 07:17:03 on dist-test-slave-7f01"
server_key: "98107e11eb5550760c4203eb64f44a64"
server_key_iv: "3a05bc65a5374523d86def683edb3f7c"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.412976 21434 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:03.414373 21434 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 07:17:03.414446 21434 log.cc:1196] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 07:17:03.414639 21434 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: Deleting consensus metadata
I20260811 07:17:03.414803 21434 master_runner.cc:315] Copying system tablet from 127.9.142.190:42895
I20260811 07:17:03.415423 21434 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: tablet copy: Beginning tablet copy session from remote peer at address 127.9.142.190:42895
I20260811 07:17:03.426944 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.415937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55288 (local address 127.9.142.190:42895)
0811 07:17:03.415984 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.415986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.419959 (+ 3973us) server_negotiation.cc:407] Connection header received
0811 07:17:03.420007 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.420008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.420022 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.420097 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.420475 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.421256 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.422284 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.422612 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.422682 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.423931 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.423933 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.423934 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.423942 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.425651 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.426066 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.426067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.426068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.426133 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.426365 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.426366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.426366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.426504 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.426572 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.426754 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.426848 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:17:03.426954 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.415696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55288)
0811 07:17:03.419855 (+ 4159us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.419870 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.419952 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.420117 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.420118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.420333 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.420395 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.420398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.421364 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.421365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.422187 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.422190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.422694 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.422696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.422760 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.423322 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.423328 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.423835 (+ 507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.425747 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.425748 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.425749 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.425983 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.426213 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.426214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.426215 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.426291 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.426583 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.426585 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.426637 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.426720 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.426851 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4130,"thread_start_us":199,"threads_started":1}
I20260811 07:17:03.427587 20379 tablet_copy_service.cc:140] P 3f8823b7fd0d4052bc83b47b9bae3fdf: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 91cd75cf10964e43badda4d74723ed86 ({username='oryx', principal='oryx/127.9.142.188@KRBTEST.COM'} at 127.0.0.1:55288)
I20260811 07:17:03.427657 20379 tablet_copy_service.cc:161] P 3f8823b7fd0d4052bc83b47b9bae3fdf: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 91cd75cf10964e43badda4d74723ed86 at {username='oryx', principal='oryx/127.9.142.188@KRBTEST.COM'} at 127.0.0.1:55288: session id = 91cd75cf10964e43badda4d74723ed86-00000000000000000000000000000000
I20260811 07:17:03.428289 20379 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 07:17:03.428785 21434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 07:17:03.430090 21434 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: tablet copy: Starting download of 0 data blocks...
I20260811 07:17:03.430227 21434 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: tablet copy: Starting download of 1 WAL segments...
I20260811 07:17:03.431099 21434 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 07:17:03.432111 20379 tablet_copy_service.cc:342] P 3f8823b7fd0d4052bc83b47b9bae3fdf: Request end of tablet copy session 91cd75cf10964e43badda4d74723ed86-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.142.188@KRBTEST.COM'} at 127.0.0.1:55288
I20260811 07:17:03.432168 20379 tablet_copy_service.cc:433] P 3f8823b7fd0d4052bc83b47b9bae3fdf: ending tablet copy session 91cd75cf10964e43badda4d74723ed86-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 91cd75cf10964e43badda4d74723ed86
I20260811 07:17:03.435447 21434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:03.436587 21615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.436666 21614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:03.440557 21434 server_base.cc:1034] running on GCE node
W20260811 07:17:03.440630 21617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:03.440827 21434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:03.440976 21434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:03.442106 21434 hybrid_clock.cc:648] HybridClock initialized: now 1786432623442115 us; error 47 us; skew 500 ppm
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:03.443831 21434 init.cc:377] Logged in from keytab as oryx/127.9.142.188@KRBTEST.COM (short username oryx)
I20260811 07:17:03.444109 21434 webserver.cc:460] Webserver started at http://127.9.142.188:34753/ using document root <none> and password file <none>
I20260811 07:17:03.444235 21434 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:03.444271 21434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:03.445042 21434 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:03.445709 21628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.445905 21434 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:03.445973 21434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal
uuid: "91cd75cf10964e43badda4d74723ed86"
format_stamp: "Formatted at 2026-08-11 07:17:03 on dist-test-slave-7f01"
server_key: "98107e11eb5550760c4203eb64f44a64"
server_key_iv: "3a05bc65a5374523d86def683edb3f7c"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.446046 21434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:03.452955 21434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:03.454823 21434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:03.458048 21434 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.188:36097
I20260811 07:17:03.458436 21434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
I20260811 07:17:03.459414 21719 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:17:03.459928 21719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: Bootstrap starting.
I20260811 07:17:03.461193 21714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.188:36097 every 8 connection(s)
I20260811 07:17:03.462922 21719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:17:03.463140 21719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: Bootstrap complete.
I20260811 07:17:03.463323 21719 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } }
I20260811 07:17:03.463418 21719 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 91cd75cf10964e43badda4d74723ed86, State: Initialized, Role: LEARNER
I20260811 07:17:03.463454 21719 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } }
I20260811 07:17:03.463675 21719 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:03.463649 21722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.463913 21722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:17:03.465138 21739 catalog_manager.cc:1259] Loaded cluster ID: 54274404cc7841ef8a22ac91dd2a23f1
I20260811 07:17:03.465368 21739 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: loading cluster ID for follower catalog manager: success
I20260811 07:17:03.466790 21739 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: acquiring CA information for follower catalog manager: success
I20260811 07:17:03.467105 21739 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 07:17:03.502264 21599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:03.502519 21599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:03.502560 21599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:03.503727 21599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:03.503826 21599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:03.503876 21599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:17:03.505550 21599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab
--principal=oryx/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:33611
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=44251
--tserver_master_addrs=127.9.142.190:42895,127.9.142.189:46257,127.9.142.188:36097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:03.505833 21599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:03.506170 21599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:03.511615 21747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.511600 21748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.511603 21751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:03.511843 21599 server_base.cc:1034] running on GCE node
I20260811 07:17:03.512107 21599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:03.512408 21599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:03.513595 21599 hybrid_clock.cc:648] HybridClock initialized: now 1786432623513568 us; error 37 us; skew 500 ppm
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:03.516360 21599 init.cc:377] Logged in from keytab as oryx/127.9.142.129@KRBTEST.COM (short username oryx)
I20260811 07:17:03.516940 21599 webserver.cc:460] Webserver started at http://127.9.142.129:44251/ using document root <none> and password file <none>
I20260811 07:17:03.517189 21599 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:03.517273 21599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:03.518697 21599 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 07:17:03.519421 21758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.519629 21599 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:03.519739 21599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "86748627d0a1448cb659320148462ddc"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "4c8be3607d0acd59eb21bd8926c41a86"
server_key_iv: "3f4626e04ba6c64201a86b648e2e4272"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.520156 21599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:03.543939 21599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:03.546491 21599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:03.546665 21599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:03.546980 21599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:03.547384 21599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:03.547444 21599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.547485 21599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:03.547514 21599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.554472 21599 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:33611
I20260811 07:17:03.554533 21967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:33611 every 8 connection(s)
I20260811 07:17:03.554881 21599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:17:03.556113 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 21599
I20260811 07:17:03.556316 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 20668
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.189@KRBTEST.COM
I20260811 07:17:03.570411 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.555653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:48305 (local address 127.9.142.189:46257)
0811 07:17:03.555784 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.555786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.556046 (+ 260us) server_negotiation.cc:407] Connection header received
0811 07:17:03.559119 (+ 3073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.559121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.559137 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.559205 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.559849 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.560956 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.562373 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.562773 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.562825 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.566198 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.566201 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.566201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.566212 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.568254 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.568961 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.568963 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.568964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.569041 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.569420 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.569422 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.569422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.569635 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.569706 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.570190 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.570278 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 07:17:03.571281 21977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.555624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.9.142.129:48305)
0811 07:17:03.555918 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.555946 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.556643 (+ 697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.559268 (+ 2625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.559270 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.559557 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.559693 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.559696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.561077 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.561078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.562255 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.562259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.562937 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.562939 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.563033 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.563915 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.563930 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.566088 (+ 2158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.568374 (+ 2286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.568385 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.568388 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.568829 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.569128 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.569129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.569130 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.569319 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.569749 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.569758 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.570019 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.570785 (+ 766us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.570980 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":2,"thread_start_us":132,"threads_started":1}
I20260811 07:17:03.571954 21973 heartbeater.cc:347] Connected to a master server at 127.9.142.189:46257
I20260811 07:17:03.572108 21973 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:03.572352 21973 heartbeater.cc:511] Master 127.9.142.189:46257 requested a full tablet report, sending...
I20260811 07:17:03.572918 21344 ts_manager.cc:194] Registered new tserver with Master: 86748627d0a1448cb659320148462ddc (127.9.142.129:33611)
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:03.582022 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.555624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.129:58543)
0811 07:17:03.556798 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.556807 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.556871 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.557108 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.557111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.557755 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.558009 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.558015 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.558868 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.558868 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.560041 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.560043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.560518 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.560519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.560644 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.576822 (+ 16178us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.576828 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.578516 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.580729 (+ 2213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.580730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.580730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.580979 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.581222 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.581223 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.581224 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.581298 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.581630 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.581631 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.581706 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.581779 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.581883 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1147,"mutex_wait_us":65,"thread_start_us":93,"threads_started":1}
I20260811 07:17:03.582050 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.555712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:58543 (local address 127.9.142.190:42895)
0811 07:17:03.555825 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.555827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.556847 (+ 1020us) server_negotiation.cc:407] Connection header received
0811 07:17:03.556936 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.556938 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.556950 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.556977 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.558111 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.558769 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.560131 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.560401 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.560439 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.578620 (+ 18181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.578622 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.578623 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.578632 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.580633 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.581081 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.581083 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.581083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.581153 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.581380 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.581381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.581381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.581539 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.581605 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.581824 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.581915 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 07:17:03.582492 21972 heartbeater.cc:347] Connected to a master server at 127.9.142.190:42895
I20260811 07:17:03.582562 21972 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:03.582659 21972 heartbeater.cc:511] Master 127.9.142.190:42895 requested a full tablet report, sending...
I20260811 07:17:03.582995 20356 ts_manager.cc:194] Re-registered known tserver with Master: 86748627d0a1448cb659320148462ddc (127.9.142.129:33611)
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.188@KRBTEST.COM
I20260811 07:17:03.583626 20356 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:58543
I20260811 07:17:03.583801 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:36411
--local_ip_for_outbound_sockets=127.9.142.130
--tserver_master_addrs=127.9.142.190:42895
--webserver_port=37567
--webserver_interface=127.9.142.130
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab
--principal=oryx/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.142.190:42895,127.9.142.189:46257
--tserver_master_addrs=127.9.142.190:42895,127.9.142.189:46257,127.9.142.188:36097 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:17:03.586846 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.555940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:38711 (local address 127.9.142.188:36097)
0811 07:17:03.577578 (+ 21638us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.577580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.577593 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:17:03.577625 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.577626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.577641 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.577727 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.578159 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.579242 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.580327 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.580796 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.580889 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.584000 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.584001 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.584002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.584010 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.585602 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.585977 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.585978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.585979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.586049 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.586256 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.586257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.586258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.586394 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.586473 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.586632 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.586722 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21605,"thread_start_us":57,"threads_started":1}
I20260811 07:17:03.586943 21975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.555624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36097 (local address 127.9.142.129:38711)
0811 07:17:03.555901 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.555945 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.563274 (+ 7329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.577767 (+ 14493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.577768 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.577966 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.578042 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.578045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.579342 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.579343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.580217 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.580221 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.580886 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.580887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.580974 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.581407 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.581412 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.583890 (+ 2478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.585693 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.585694 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.585695 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.585883 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.586117 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.586118 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.586118 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.586178 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.586464 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.586465 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.586511 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.586592 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.586720 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":80,"threads_started":1}
I20260811 07:17:03.587309 21970 heartbeater.cc:347] Connected to a master server at 127.9.142.188:36097
I20260811 07:17:03.587371 21970 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:03.587499 21970 heartbeater.cc:511] Master 127.9.142.188:36097 requested a full tablet report, sending...
I20260811 07:17:03.587944 21648 ts_manager.cc:194] Registered new tserver with Master: 86748627d0a1448cb659320148462ddc (127.9.142.129:33611)
W20260811 07:17:03.677285 21983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:03.677552 21983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:03.677592 21983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:03.678776 21983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:03.678846 21983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:03.678891 21983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:17:03.680544 21983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab
--principal=oryx/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:36411
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=37567
--tserver_master_addrs=127.9.142.190:42895,127.9.142.189:46257,127.9.142.188:36097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:03.680836 21983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:03.681113 21983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:03.686465 21994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.686489 21989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.686522 21990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:03.686700 21983 server_base.cc:1034] running on GCE node
I20260811 07:17:03.686951 21983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:03.687251 21983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:03.688516 21983 hybrid_clock.cc:648] HybridClock initialized: now 1786432623688499 us; error 33 us; skew 500 ppm
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:03.692262 21983 init.cc:377] Logged in from keytab as oryx/127.9.142.130@KRBTEST.COM (short username oryx)
I20260811 07:17:03.692903 21983 webserver.cc:460] Webserver started at http://127.9.142.130:37567/ using document root <none> and password file <none>
I20260811 07:17:03.693200 21983 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:03.693291 21983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:03.694810 21983 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:03.695683 22012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.695927 21983 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:03.696115 21983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "73f895fa3e67477a9ac1ff0df1c30d74"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "693222ce8ca9e5eabb02680bb9a024c7"
server_key_iv: "10f07230212da53ecaeaeed37f187ea4"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.696601 21983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:03.712334 21983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:03.714581 21983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:03.714782 21983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:03.715075 21983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:03.715445 21983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:03.715512 21983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.715560 21983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:03.715598 21983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.723810 21983 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:36411
I20260811 07:17:03.723891 22200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:36411 every 8 connection(s)
I20260811 07:17:03.724318 21983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:17:03.730727 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 21983
I20260811 07:17:03.730927 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 20887
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.188@KRBTEST.COM
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.189@KRBTEST.COM
I20260811 07:17:03.741362 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.725301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:52469 (local address 127.9.142.188:36097)
0811 07:17:03.725351 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.725373 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.727601 (+ 2228us) server_negotiation.cc:407] Connection header received
0811 07:17:03.727635 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.727636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.727654 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.727755 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.728568 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.729210 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.730900 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.731177 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.731214 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.736043 (+ 4829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.736044 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.736044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.736052 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.739380 (+ 3328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.740137 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.740138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.740138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.740221 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.740527 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.740527 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.740528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.740664 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.740710 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.741092 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.741218 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 07:17:03.741767 22213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.725190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36097 (local address 127.9.142.130:52469)
0811 07:17:03.727506 (+ 2316us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.727519 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.727576 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.727837 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.727838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.728198 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.728435 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.728441 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.729349 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.729350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.730790 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.730793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.731436 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.731437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.731573 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.734238 (+ 2665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.734249 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.735929 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.739496 (+ 3567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.739508 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.739512 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.739968 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.740315 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.740316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.740316 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.740463 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.740737 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.740742 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.740900 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.740993 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.741169 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2287,"mutex_wait_us":177,"thread_start_us":651,"threads_started":1}
I20260811 07:17:03.742604 22201 heartbeater.cc:347] Connected to a master server at 127.9.142.188:36097
I20260811 07:17:03.742710 22201 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:03.742929 22201 heartbeater.cc:511] Master 127.9.142.188:36097 requested a full tablet report, sending...
I20260811 07:17:03.743413 21648 ts_manager.cc:194] Registered new tserver with Master: 73f895fa3e67477a9ac1ff0df1c30d74 (127.9.142.130:36411)
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:03.745288 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.725277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:37967 (local address 127.9.142.189:46257)
0811 07:17:03.725341 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.725344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.727727 (+ 2383us) server_negotiation.cc:407] Connection header received
0811 07:17:03.727816 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.727817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.727829 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.727879 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.728729 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.729402 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.737072 (+ 7670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.737365 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.737433 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.740571 (+ 3138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.740573 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.740573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.740584 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.743974 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.744386 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.744388 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.744389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.744473 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.744711 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.744713 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.744713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.744858 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.744905 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.745077 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.745159 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 07:17:03.746012 22209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.725190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.9.142.130:37967)
0811 07:17:03.727662 (+ 2472us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.727670 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.727728 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.727898 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.727899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.728203 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.728543 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.728547 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.729528 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.729529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.730781 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.730784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.737490 (+ 6706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.737491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.737568 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.738687 (+ 1119us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.738692 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.740440 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.744073 (+ 3633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.744075 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.744075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.744295 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.744557 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.744557 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.744558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.744629 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.744943 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.744944 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.744983 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.745561 (+ 578us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.745833 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2439,"mutex_wait_us":320,"thread_start_us":322,"threads_started":1}
I20260811 07:17:03.746819 22205 heartbeater.cc:347] Connected to a master server at 127.9.142.189:46257
I20260811 07:17:03.746897 22205 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:03.747002 22205 heartbeater.cc:511] Master 127.9.142.189:46257 requested a full tablet report, sending...
I20260811 07:17:03.747418 21344 ts_manager.cc:194] Registered new tserver with Master: 73f895fa3e67477a9ac1ff0df1c30d74 (127.9.142.130:36411)
I20260811 07:17:03.747716 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.725283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:35017 (local address 127.9.142.190:42895)
0811 07:17:03.725509 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.725511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.726127 (+ 616us) server_negotiation.cc:407] Connection header received
0811 07:17:03.727358 (+ 1231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.727360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.727432 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.727502 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.729308 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.730210 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.738842 (+ 8632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.739172 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.739227 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.744621 (+ 5394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.744623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.744624 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.744634 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.746470 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.746899 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.746901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.746901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.746968 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.747147 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.747148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.747149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.747268 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.747348 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.747523 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.747615 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:17:03.748095 22214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.725190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.130:35017)
0811 07:17:03.725993 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.726035 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.727224 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.727646 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.727651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.728192 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.728435 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.728441 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.730319 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.730320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.738720 (+ 8400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.738724 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.739336 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.739337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.739454 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.743053 (+ 3599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.743058 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.744535 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.746557 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.746559 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.746559 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.746812 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.747031 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.747032 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.747032 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.747093 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.747345 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.747347 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.747394 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.747846 (+ 452us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.747971 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"mutex_wait_us":4,"thread_start_us":639,"threads_started":1}
I20260811 07:17:03.748521 22202 heartbeater.cc:347] Connected to a master server at 127.9.142.190:42895
I20260811 07:17:03.748577 22202 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:03.748648 22202 heartbeater.cc:511] Master 127.9.142.190:42895 requested a full tablet report, sending...
I20260811 07:17:03.748924 20356 ts_manager.cc:194] Re-registered known tserver with Master: 73f895fa3e67477a9ac1ff0df1c30d74 (127.9.142.130:36411)
I20260811 07:17:03.749318 20356 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:35017
I20260811 07:17:03.753973 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:45575
--local_ip_for_outbound_sockets=127.9.142.131
--tserver_master_addrs=127.9.142.190:42895
--webserver_port=36647
--webserver_interface=127.9.142.131
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab
--principal=oryx/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.142.190:42895,127.9.142.189:46257
--tserver_master_addrs=127.9.142.190:42895,127.9.142.189:46257,127.9.142.188:36097 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:03.846156 22216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:03.846504 22216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:03.846553 22216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:03.848063 22216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:03.848130 22216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:03.848181 22216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:17:03.849936 22216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab
--principal=oryx/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:45575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=36647
--tserver_master_addrs=127.9.142.190:42895,127.9.142.189:46257,127.9.142.188:36097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:03.850222 22216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:03.850473 22216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:03.856161 22226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.856170 22221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:03.856221 22222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:03.856639 22216 server_base.cc:1034] running on GCE node
I20260811 07:17:03.856814 22216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:03.857002 22216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:03.858150 22216 hybrid_clock.cc:648] HybridClock initialized: now 1786432623858124 us; error 42 us; skew 500 ppm
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:03.861064 22216 init.cc:377] Logged in from keytab as oryx/127.9.142.131@KRBTEST.COM (short username oryx)
I20260811 07:17:03.861523 22216 webserver.cc:460] Webserver started at http://127.9.142.131:36647/ using document root <none> and password file <none>
I20260811 07:17:03.861794 22216 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:03.861889 22216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:03.863363 22216 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:17:03.864352 22236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.864629 22216 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:17:03.864760 22216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "840521325ce34ce186c304c939f5b744"
format_stamp: "Formatted at 2026-08-11 07:17:02 on dist-test-slave-7f01"
server_key: "fdf5f6cad4eb99c68d66af6f6a9946fc"
server_key_iv: "6ed12a06d01d25697aae8df243f9decc"
server_key_version: "encryptionkey@0"
I20260811 07:17:03.865116 22216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:03.889322 22216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:03.891363 22216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:03.891547 22216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:03.891901 22216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:03.892254 22216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:03.892292 22216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.892351 22216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:03.892379 22216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:03.899314 22216 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:45575
I20260811 07:17:03.899389 22421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:45575 every 8 connection(s)
I20260811 07:17:03.899863 22216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.188@KRBTEST.COM
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
Aug 11 07:17:03 dist-test-slave-7f01 krb5kdc[20269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432623, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.189@KRBTEST.COM
I20260811 07:17:03.910465 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 22216
I20260811 07:17:03.912420 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.900845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:55855 (local address 127.9.142.188:36097)
0811 07:17:03.900895 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.900897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.901237 (+ 340us) server_negotiation.cc:407] Connection header received
0811 07:17:03.901926 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.901928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.901943 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.901992 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.902829 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.903723 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.905188 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.905546 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.905591 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.908319 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.908321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.908321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.908327 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.910214 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.911099 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.911101 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.911102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.911174 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.911499 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.911500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.911501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.911653 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.911706 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.912212 (+ 506us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.912320 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:17:03.912431 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.900720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:42581 (local address 127.9.142.190:42895)
0811 07:17:03.900835 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.900837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.902061 (+ 1224us) server_negotiation.cc:407] Connection header received
0811 07:17:03.902543 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.902544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.902556 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.902620 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.902978 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.903805 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.905172 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.905377 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.905471 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.908912 (+ 3441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.908914 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.908914 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.908923 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.910859 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.911314 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.911316 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.911316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.911381 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.911607 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.911608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.911608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.911770 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.911824 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.912207 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.912323 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 07:17:03.913084 22431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.900591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.131:42581)
0811 07:17:03.902002 (+ 1411us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.902013 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.902438 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.902667 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.902668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.902839 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.902892 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.902894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.903915 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.903916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.905075 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.905078 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.905504 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.905505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.905631 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.906235 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.906245 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.908823 (+ 2578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.910955 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.910956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.910957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.911218 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.911461 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.911462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.911462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.911529 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.911881 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.911882 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.912026 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.912582 (+ 556us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.912796 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1384,"mutex_wait_us":376,"thread_start_us":80,"threads_started":1}
I20260811 07:17:03.913091 22433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.900590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36097 (local address 127.9.142.131:55855)
0811 07:17:03.901105 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.901170 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.901820 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.902082 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.902086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.902433 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.902722 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.902728 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.903913 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.903914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.905078 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.905081 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.905681 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.905682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.905758 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.906395 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.906400 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.908225 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.910307 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.910316 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.910318 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.910983 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.911260 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.911261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.911261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.911408 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.911810 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.911818 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.912023 (+ 205us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.912543 (+ 520us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.912966 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":268,"thread_start_us":96,"threads_started":1}
I20260811 07:17:03.913820 22425 heartbeater.cc:347] Connected to a master server at 127.9.142.190:42895
I20260811 07:17:03.913865 22423 heartbeater.cc:347] Connected to a master server at 127.9.142.188:36097
I20260811 07:17:03.913937 22425 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:03.913937 22423 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:03.914163 22425 heartbeater.cc:511] Master 127.9.142.190:42895 requested a full tablet report, sending...
I20260811 07:17:03.914716 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.900726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:56457 (local address 127.9.142.189:46257)
0811 07:17:03.900869 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.900871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.901230 (+ 359us) server_negotiation.cc:407] Connection header received
0811 07:17:03.901921 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.901922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.901937 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.901999 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.903858 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.904613 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.905709 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.905967 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.906085 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.909464 (+ 3379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.909465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.909466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.909474 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.911384 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.911840 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.911842 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.911842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.911909 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.912306 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.912307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.912307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.912466 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.912520 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.914554 (+ 2034us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.914649 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260811 07:17:03.914162 22423 heartbeater.cc:511] Master 127.9.142.188:36097 requested a full tablet report, sending...
I20260811 07:17:03.915093 20356 ts_manager.cc:194] Re-registered known tserver with Master: 840521325ce34ce186c304c939f5b744 (127.9.142.131:45575)
I20260811 07:17:03.915375 21648 ts_manager.cc:194] Registered new tserver with Master: 840521325ce34ce186c304c939f5b744 (127.9.142.131:45575)
I20260811 07:17:03.915572 20356 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:42581
I20260811 07:17:03.916656 22432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.900590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.9.142.131:56457)
0811 07:17:03.901105 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.901142 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.901807 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.902083 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.902086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.902456 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:03.902722 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.902727 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.904713 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.904714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.905620 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.905623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.906177 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.906178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.906311 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.906734 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:03.906739 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:03.909364 (+ 2625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:03.911481 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.911482 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.911483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.911706 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.911990 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:03.911991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:03.911991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:03.912215 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:03.913014 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:03.913014 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:03.913060 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.916396 (+ 3336us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.916497 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":3,"thread_start_us":81,"threads_started":1}
I20260811 07:17:03.917088 22426 heartbeater.cc:347] Connected to a master server at 127.9.142.189:46257
I20260811 07:17:03.917145 22426 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:03.917222 22426 heartbeater.cc:511] Master 127.9.142.189:46257 requested a full tablet report, sending...
I20260811 07:17:03.917541 21344 ts_manager.cc:194] Registered new tserver with Master: 840521325ce34ce186c304c939f5b744 (127.9.142.131:45575)
I20260811 07:17:03.921417 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.912109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55294 (local address 127.9.142.190:42895)
0811 07:17:03.912515 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.912518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.912899 (+ 381us) server_negotiation.cc:407] Connection header received
0811 07:17:03.912994 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.912995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.913005 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.913032 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.914154 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.914888 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.915921 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.916229 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.916310 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.918183 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.918185 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.918185 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.918193 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.920165 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.920495 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.920496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.920496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.920561 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.920767 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.920768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.920768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.920898 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.920999 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.921185 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.921294 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":58,"threads_started":1}
I20260811 07:17:03.921660 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.911586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54988 (local address 127.9.142.188:36097)
0811 07:17:03.912508 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.912510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.912869 (+ 359us) server_negotiation.cc:407] Connection header received
0811 07:17:03.913344 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.913346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.913359 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.913393 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.914235 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.914938 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.916593 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.916901 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.916972 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.918606 (+ 1634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.918607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.918607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.918614 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.920473 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.920848 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.920849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.920849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.920904 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.921119 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.921120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.921120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.921242 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.921344 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.921486 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.921569 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":905,"thread_start_us":65,"threads_started":1}
I20260811 07:17:03.923220 20356 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:17:03.925814 20356 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:17:03.926116 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.912537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53530 (local address 127.9.142.189:46257)
0811 07:17:03.914823 (+ 2286us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.914826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.914835 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:03.914858 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.914859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.914872 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.914930 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:03.918260 (+ 3330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.918906 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.921397 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.921671 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.921740 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.923363 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:03.923364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:03.923364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:03.923371 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:03.924913 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.925264 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.925265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.925265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.925328 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:03.925516 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:03.925517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:03.925517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:03.925649 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:03.925744 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.925964 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.926038 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2268,"thread_start_us":64,"threads_started":1}
I20260811 07:17:03.933341 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.930001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50606 (local address 127.9.142.131:45575)
0811 07:17:03.930172 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.930177 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.930186 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:03.930218 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.930220 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.930233 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.930491 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:03.930536 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.931152 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.932435 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.933010 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.933099 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.933193 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.933222 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.933253 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260811 07:17:03.933447 22467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.929837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:45575 (local address 127.0.0.1:50606)
0811 07:17:03.929986 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.929996 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.930050 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.930361 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.930362 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.930364 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:03.930413 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.930415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.931251 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.931252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.932337 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.932339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.933100 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.933101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.933162 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.933166 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.933211 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.933251 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":3,"thread_start_us":61,"threads_started":1}
I20260811 07:17:03.933825 22464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.929454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33611 (local address 127.0.0.1:57490)
0811 07:17:03.929595 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.929605 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.929652 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.930039 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.930040 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.930042 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:03.930104 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.930106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.931574 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.931575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.932661 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.932664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.933587 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.933588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.933659 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.933662 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.933709 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.933751 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":102,"threads_started":1}
I20260811 07:17:03.934026 22471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.929654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:36411 (local address 127.0.0.1:39144)
0811 07:17:03.929953 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.929965 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.930009 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.930374 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.930375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.930377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:03.930430 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.930432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.931620 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.931621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.932573 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.932576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.933800 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.933801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.933862 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.933866 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.933921 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.933964 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":19,"thread_start_us":87,"threads_started":1}
I20260811 07:17:03.934201 22466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.929551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57490 (local address 127.9.142.129:33611)
0811 07:17:03.929790 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.929794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.929806 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:17:03.929845 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.929847 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.929859 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.929954 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:03.930311 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.931478 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.932728 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.933404 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.933480 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.933550 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.933982 (+ 432us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.934038 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":124,"threads_started":1}
I20260811 07:17:03.934275 22468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.929791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39144 (local address 127.9.142.130:36411)
0811 07:17:03.930147 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.930152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.930161 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:03.930202 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.930204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.930220 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.930302 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:03.930500 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.931558 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.932660 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.933380 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.933660 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.933765 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.934133 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.934179 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":99,"threads_started":1}
I20260811 07:17:03.934296 22317 tablet_service.cc:1467] Processing CreateTablet for tablet 99a1fd6625f249a787a5b3e65d7a752f (DEFAULT_TABLE table=test-table [id=5331857f4125479b80b72bd84e57cba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:03.934751 22317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99a1fd6625f249a787a5b3e65d7a752f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:03.934906 22092 tablet_service.cc:1467] Processing CreateTablet for tablet 99a1fd6625f249a787a5b3e65d7a752f (DEFAULT_TABLE table=test-table [id=5331857f4125479b80b72bd84e57cba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:03.934825 21844 tablet_service.cc:1467] Processing CreateTablet for tablet 99a1fd6625f249a787a5b3e65d7a752f (DEFAULT_TABLE table=test-table [id=5331857f4125479b80b72bd84e57cba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:03.935228 22092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99a1fd6625f249a787a5b3e65d7a752f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:03.935251 21844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99a1fd6625f249a787a5b3e65d7a752f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:03.938469 22474 tablet_bootstrap.cc:492] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: Bootstrap starting.
I20260811 07:17:03.938907 22475 tablet_bootstrap.cc:492] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: Bootstrap starting.
I20260811 07:17:03.939047 22476 tablet_bootstrap.cc:492] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: Bootstrap starting.
I20260811 07:17:03.939131 22474 tablet_bootstrap.cc:654] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:03.939577 22474 log.cc:824] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:03.939605 22475 tablet_bootstrap.cc:654] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:03.939868 22476 tablet_bootstrap.cc:654] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:03.940006 22475 log.cc:824] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:03.940197 22476 log.cc:824] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:03.940629 22474 tablet_bootstrap.cc:492] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: No bootstrap required, opened a new log
I20260811 07:17:03.940721 22474 ts_tablet_manager.cc:1397] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:17:03.941026 22476 tablet_bootstrap.cc:492] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: No bootstrap required, opened a new log
I20260811 07:17:03.941097 22476 ts_tablet_manager.cc:1397] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:17:03.942858 22475 tablet_bootstrap.cc:492] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: No bootstrap required, opened a new log
I20260811 07:17:03.942783 22474 raft_consensus.cc:348] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:03.942946 22475 ts_tablet_manager.cc:1397] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 07:17:03.942955 22474 raft_consensus.cc:374] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:03.943003 22474 raft_consensus.cc:729] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86748627d0a1448cb659320148462ddc, State: Initialized, Role: FOLLOWER
I20260811 07:17:03.943120 22474 consensus_queue.cc:260] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:03.943424 22474 ts_tablet_manager.cc:1428] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:17:03.943547 22476 raft_consensus.cc:348] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:03.943701 22476 raft_consensus.cc:374] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:03.943759 22476 raft_consensus.cc:729] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73f895fa3e67477a9ac1ff0df1c30d74, State: Initialized, Role: FOLLOWER
I20260811 07:17:03.943873 22476 consensus_queue.cc:260] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:03.944131 22476 ts_tablet_manager.cc:1428] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:17:03.944224 22202 heartbeater.cc:503] Master 127.9.142.190:42895 was elected leader, sending a full tablet report...
I20260811 07:17:03.945047 22475 raft_consensus.cc:348] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:03.945216 22475 raft_consensus.cc:374] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:03.945255 21972 heartbeater.cc:503] Master 127.9.142.190:42895 was elected leader, sending a full tablet report...
I20260811 07:17:03.945271 22475 raft_consensus.cc:729] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840521325ce34ce186c304c939f5b744, State: Initialized, Role: FOLLOWER
I20260811 07:17:03.945377 22475 consensus_queue.cc:260] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:03.945746 22475 ts_tablet_manager.cc:1428] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 07:17:03.945852 22425 heartbeater.cc:503] Master 127.9.142.190:42895 was elected leader, sending a full tablet report...
W20260811 07:17:03.976161 22208 tablet.cc:2369] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:17:03.982685 22464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.979313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36097 (local address 127.0.0.1:54990)
0811 07:17:03.979368 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:03.979382 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:03.979427 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:03.979598 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:03.979599 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:03.979600 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:03.979652 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.979654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.980373 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.980374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.981488 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:03.981492 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.982357 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.982358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:03.982444 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.982449 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:17:03.982508 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 07:17:03.982565 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 07:17:03.982961 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:03.979371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54990 (local address 127.9.142.188:36097)
0811 07:17:03.979437 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:03.979439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:03.979451 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:17:03.979497 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:03.979498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:03.979527 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:03.979594 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:03.979702 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.980289 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.981568 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:03.982254 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:03.982331 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:03.982413 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:03.982816 (+ 403us) server_negotiation.cc:299] Negotiation successful
0811 07:17:03.982874 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 07:17:03.983335 21670 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 07:17:03.984776 22486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f8823b7fd0d4052bc83b47b9bae3fdf. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:03.984938 22486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:17:04.049711 22483 raft_consensus.cc:482] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:17:04.049860 22483 raft_consensus.cc:504] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:04.050321 22483 leader_election.cc:288] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86748627d0a1448cb659320148462ddc (127.9.142.129:33611), 840521325ce34ce186c304c939f5b744 (127.9.142.131:45575)
I20260811 07:17:04.054368 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:04.050787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:44409 (local address 127.9.142.131:45575)
0811 07:17:04.050860 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:04.050863 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:04.050871 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:04.050902 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:04.050903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:04.050912 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:04.050967 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:04.051127 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.051873 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.053410 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.053972 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.054060 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:04.054069 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:04.054249 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 07:17:04.054299 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:17:04.054368 22466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:04.050589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:54423 (local address 127.9.142.129:33611)
0811 07:17:04.050714 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:04.050717 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:04.050726 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:04.050759 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:04.050760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:04.050794 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:04.050867 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:04.051065 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.051893 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.053409 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.053983 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.054060 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:04.054069 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:04.054249 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 07:17:04.054294 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 07:17:04.054387 22214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:04.050512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33611 (local address 127.9.142.130:54423)
0811 07:17:04.050587 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:04.050602 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:04.050666 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:04.050880 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:04.050881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:04.050882 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:04.050979 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:04.050981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.051989 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.051990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:04.053294 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:04.053298 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.054069 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.054070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:04.054163 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:04.054164 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 07:17:04.054219 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 07:17:04.054271 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":93}
I20260811 07:17:04.054399 22209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:04.050633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:45575 (local address 127.9.142.130:44409)
0811 07:17:04.050675 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:04.050684 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:04.050720 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:04.050996 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:04.050997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:04.050998 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:04.051051 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:04.051052 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.051971 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.051972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:04.053294 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:04.053298 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.054069 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.054070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:04.054154 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:04.054158 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:04.054219 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 07:17:04.054271 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":62}
I20260811 07:17:04.054908 21877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a1fd6625f249a787a5b3e65d7a752f" candidate_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86748627d0a1448cb659320148462ddc" is_pre_election: true
I20260811 07:17:04.055097 21877 raft_consensus.cc:2454] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73f895fa3e67477a9ac1ff0df1c30d74 in term 0.
I20260811 07:17:04.055073 22349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a1fd6625f249a787a5b3e65d7a752f" candidate_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840521325ce34ce186c304c939f5b744" is_pre_election: true
I20260811 07:17:04.055197 22349 raft_consensus.cc:2454] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73f895fa3e67477a9ac1ff0df1c30d74 in term 0.
I20260811 07:17:04.055327 22017 leader_election.cc:302] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73f895fa3e67477a9ac1ff0df1c30d74, 86748627d0a1448cb659320148462ddc; no voters:
I20260811 07:17:04.055464 22483 raft_consensus.cc:2781] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:17:04.055521 22483 raft_consensus.cc:482] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:17:04.055557 22483 raft_consensus.cc:3037] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Advancing to term 1
W20260811 07:17:04.055850 21974 tablet.cc:2369] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:17:04.056443 22483 raft_consensus.cc:504] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:04.056591 22483 leader_election.cc:288] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [CANDIDATE]: Term 1 election: Requested vote from peers 86748627d0a1448cb659320148462ddc (127.9.142.129:33611), 840521325ce34ce186c304c939f5b744 (127.9.142.131:45575)
I20260811 07:17:04.056749 21877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a1fd6625f249a787a5b3e65d7a752f" candidate_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86748627d0a1448cb659320148462ddc"
I20260811 07:17:04.056787 22349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a1fd6625f249a787a5b3e65d7a752f" candidate_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840521325ce34ce186c304c939f5b744"
I20260811 07:17:04.056838 21877 raft_consensus.cc:3037] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:04.056890 22349 raft_consensus.cc:3037] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:04.057562 21877 raft_consensus.cc:2454] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73f895fa3e67477a9ac1ff0df1c30d74 in term 1.
I20260811 07:17:04.057693 22349 raft_consensus.cc:2454] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73f895fa3e67477a9ac1ff0df1c30d74 in term 1.
I20260811 07:17:04.057802 22017 leader_election.cc:302] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73f895fa3e67477a9ac1ff0df1c30d74, 86748627d0a1448cb659320148462ddc; no voters:
I20260811 07:17:04.057964 22483 raft_consensus.cc:2781] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:04.058208 22483 raft_consensus.cc:686] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 LEADER]: Becoming Leader. State: Replica: 73f895fa3e67477a9ac1ff0df1c30d74, State: Running, Role: LEADER
I20260811 07:17:04.058318 22483 consensus_queue.cc:237] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:04.059412 20356 catalog_manager.cc:5495] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73f895fa3e67477a9ac1ff0df1c30d74 (127.9.142.130). New cstate: current_term: 1 leader_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } health_report { overall_health: UNKNOWN } } }
I20260811 07:17:04.060227 22451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: NON_VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: true } } }
I20260811 07:17:04.060352 22451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:04.061319 22451 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: attempting to promote NON_VOTER 91cd75cf10964e43badda4d74723ed86 to VOTER
I20260811 07:17:04.061458 22451 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } }
I20260811 07:17:04.061975 21360 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Refusing update from remote peer 3f8823b7fd0d4052bc83b47b9bae3fdf: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 07:17:04.062018 21669 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 LEARNER]: Refusing update from remote peer 3f8823b7fd0d4052bc83b47b9bae3fdf: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 07:17:04.062206 22502 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 07:17:04.062350 22504 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 07:17:04.063087 22502 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 91cd75cf10964e43badda4d74723ed86 (127.9.142.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:04.063235 21360 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 91cd75cf10964e43badda4d74723ed86 (127.9.142.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:04.063308 21669 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 91cd75cf10964e43badda4d74723ed86 (127.9.142.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:04.064106 22502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:04.064182 22502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:04.064263 22502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:04.064311 22502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:04.064394 22502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:04.064456 22502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:04.064498 22510 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:04.064589 22510 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:17:04.064867 22486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:04.064965 22486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:17:04.081926 22468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:04.079417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39154 (local address 127.9.142.130:36411)
0811 07:17:04.079467 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:04.079469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:04.079478 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:04.079538 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:04.079539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:04.079557 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:04.079620 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:04.079792 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.080290 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.081177 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.081376 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.081432 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:04.081619 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:04.081723 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:04.081831 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:04.081845 (+ 14us) server_negotiation.cc:299] Negotiation successful
0811 07:17:04.081864 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:17:04.084007 22349 raft_consensus.cc:1261] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [term 1 FOLLOWER]: Refusing update from remote peer 73f895fa3e67477a9ac1ff0df1c30d74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:04.084007 21877 raft_consensus.cc:1261] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [term 1 FOLLOWER]: Refusing update from remote peer 73f895fa3e67477a9ac1ff0df1c30d74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:04.084403 22497 consensus_queue.cc:1035] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:04.084565 22483 consensus_queue.cc:1035] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:04.087838 22512 mvcc.cc:205] Tried to move back new op lower bound from 7317228028244586496 to 7317228028143390720. Current Snapshot: MvccSnapshot[applied={T|T < 7317228028244586496}]
I20260811 07:17:04.088585 22513 mvcc.cc:205] Tried to move back new op lower bound from 7317228028244586496 to 7317228028143390720. Current Snapshot: MvccSnapshot[applied={T|T < 7317228028244586496 or (T in {7317228028244586496})}]
I20260811 07:17:04.090057 20355 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:04.090160 20355 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:04.091826 20355 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f8823b7fd0d4052bc83b47b9bae3fdf: Sending DeleteTablet for 3 replicas of tablet 99a1fd6625f249a787a5b3e65d7a752f
I20260811 07:17:04.092243 21844 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a1fd6625f249a787a5b3e65d7a752f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:04 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:57490
I20260811 07:17:04.092253 22317 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a1fd6625f249a787a5b3e65d7a752f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:04 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:50606
I20260811 07:17:04.092434 22314 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a1fd6625f249a787a5b3e65d7a752f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:04 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:50606
I20260811 07:17:04.092455 22524 tablet_replica.cc:330] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: stopping tablet replica
I20260811 07:17:04.092569 22524 raft_consensus.cc:2229] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:04.092549 22092 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a1fd6625f249a787a5b3e65d7a752f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:04 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:39144
I20260811 07:17:04.092676 22524 raft_consensus.cc:2258] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:04.093281 22524 ts_tablet_manager.cc:1905] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:04.093657 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 20295
I20260811 07:17:04.099630 22530 tablet_replica.cc:330] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: stopping tablet replica
I20260811 07:17:04.099963 22530 raft_consensus.cc:2229] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:17:04.100555 22530 raft_consensus.cc:2258] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:04.101037 22524 ts_tablet_manager.cc:1918] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:04.101135 22524 log.cc:1196] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/99a1fd6625f249a787a5b3e65d7a752f
I20260811 07:17:04.101464 22524 ts_tablet_manager.cc:1939] T 99a1fd6625f249a787a5b3e65d7a752f P 86748627d0a1448cb659320148462ddc: Deleting consensus metadata
I20260811 07:17:04.101912 22525 tablet_replica.cc:330] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: stopping tablet replica
I20260811 07:17:04.102025 22525 raft_consensus.cc:2229] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:04.102128 22525 raft_consensus.cc:2258] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:04.102810 22530 ts_tablet_manager.cc:1905] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:04.102811 22525 ts_tablet_manager.cc:1905] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:04.104516 22525 ts_tablet_manager.cc:1918] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:04.104521 22530 ts_tablet_manager.cc:1918] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:04.104617 22525 log.cc:1196] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/99a1fd6625f249a787a5b3e65d7a752f
I20260811 07:17:04.104911 22525 ts_tablet_manager.cc:1939] T 99a1fd6625f249a787a5b3e65d7a752f P 840521325ce34ce186c304c939f5b744: Deleting consensus metadata
I20260811 07:17:04.106590 22530 log.cc:1196] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/99a1fd6625f249a787a5b3e65d7a752f
I20260811 07:17:04.106935 22530 ts_tablet_manager.cc:1939] T 99a1fd6625f249a787a5b3e65d7a752f P 73f895fa3e67477a9ac1ff0df1c30d74: Deleting consensus metadata
W20260811 07:17:04.109851 22241 connection.cc:535] server connection from 127.0.0.1:50606 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 07:17:04.110138 21768 connection.cc:535] server connection from 127.0.0.1:57490 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 07:17:04.110172 22017 connection.cc:535] server connection from 127.0.0.1:39144 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:17:04.112358 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:04.092695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55002 (local address 127.9.142.188:36097)
0811 07:17:04.092740 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:04.092742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:04.093705 (+ 963us) server_negotiation.cc:407] Connection header received
0811 07:17:04.100150 (+ 6445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:04.100152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:04.100168 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:04.100202 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:04.104993 (+ 4791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.105698 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.106537 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.106875 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.106951 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:04.109032 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:04.109034 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:04.109034 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:04.109042 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:04.110940 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:04.111379 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:04.111380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:04.111380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:04.111448 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:04.111666 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:04.111667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:04.111667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:04.111836 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:04.111941 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:04.112182 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 07:17:04.112266 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:17:04.122152 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:04.113899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53532 (local address 127.9.142.189:46257)
0811 07:17:04.113953 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:04.113956 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:04.114049 (+ 93us) server_negotiation.cc:407] Connection header received
0811 07:17:04.114106 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:04.114107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:04.114117 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:04.114163 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:04.114852 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.115410 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.116580 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.116919 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.116990 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:04.119297 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:04.119298 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:04.119299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:04.119306 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:04.120949 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:04.121327 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:04.121328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:04.121329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:04.121394 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:04.121605 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:04.121607 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:04.121607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:04.121731 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:04.121847 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:04.121952 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 07:17:04.122028 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 07:17:04.123327 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:04.116260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55016 (local address 127.9.142.188:36097)
0811 07:17:04.116303 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:04.116305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:04.116409 (+ 104us) server_negotiation.cc:407] Connection header received
0811 07:17:04.116479 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:04.116480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:04.116489 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:04.116558 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:04.117341 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.118071 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.118739 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:04.118925 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:04.118998 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:04.120416 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:04.120417 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:04.120418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:04.120425 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:04.122135 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:04.122516 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:04.122517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:04.122517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:04.122598 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:04.122842 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:04.122843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:04.122843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:04.122982 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:04.123071 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:04.123151 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 07:17:04.123229 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:17:05.089556 22538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.089236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.129:40921)
0811 07:17:05.089399 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.089492 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
W20260811 07:17:05.089788 21972 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:42895 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
I20260811 07:17:05.092504 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.092268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.131:33981)
0811 07:17:05.092391 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.092462 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":71,"threads_started":1}
W20260811 07:17:05.092682 22425 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:42895 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
I20260811 07:17:05.093106 22541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.092922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.130:38097)
0811 07:17:05.093018 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.093069 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":47,"threads_started":1}
W20260811 07:17:05.093310 22202 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:42895 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
I20260811 07:17:05.592765 22542 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f8823b7fd0d4052bc83b47b9bae3fdf)
I20260811 07:17:05.592938 22542 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } }
I20260811 07:17:05.593199 22542 leader_election.cc:288] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f8823b7fd0d4052bc83b47b9bae3fdf (127.9.142.190:42895), 91cd75cf10964e43badda4d74723ed86 (127.9.142.188:36097)
I20260811 07:17:05.593578 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.593356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55764)
0811 07:17:05.593484 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.593539 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
W20260811 07:17:05.593761 21311 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
I20260811 07:17:05.593981 22552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f8823b7fd0d4052bc83b47b9bae3fdf)
I20260811 07:17:05.594158 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.594073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55776)
0811 07:17:05.594106 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.594131 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 07:17:05.594197 22552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } }
W20260811 07:17:05.594292 21311 leader_election.cc:334] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f8823b7fd0d4052bc83b47b9bae3fdf (127.9.142.190:42895): Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
I20260811 07:17:05.594460 22552 leader_election.cc:288] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f8823b7fd0d4052bc83b47b9bae3fdf (127.9.142.190:42895), b3a1a4cc9ff64abd8a9e7753a34096c5 (127.9.142.189:46257)
I20260811 07:17:05.594779 22554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.594556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55788)
0811 07:17:05.594683 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.594744 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":56,"threads_started":1}
W20260811 07:17:05.594925 21635 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
I20260811 07:17:05.595379 22554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.595276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55790)
0811 07:17:05.595324 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.595351 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 07:17:05.595523 21635 leader_election.cc:334] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f8823b7fd0d4052bc83b47b9bae3fdf (127.9.142.190:42895): Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
I20260811 07:17:05.597098 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.593548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55022 (local address 127.9.142.188:36097)
0811 07:17:05.593749 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:05.593751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:05.593762 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:17:05.593796 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:05.593797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:05.593831 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:05.593904 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:05.594087 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.594862 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.596237 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.596744 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.596838 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.596851 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:05.597001 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 07:17:05.597046 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":175,"thread_start_us":66,"threads_started":1}
I20260811 07:17:05.597150 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.593369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36097 (local address 127.0.0.1:55022)
0811 07:17:05.593566 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.593581 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:05.593653 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:05.593914 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:05.593915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:05.593918 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:05.593996 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.593999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.594937 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.594938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.596142 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.596145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.596844 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.596845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.596911 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.596916 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:17:05.596973 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 07:17:05.597061 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":39,"thread_start_us":43,"threads_started":1}
I20260811 07:17:05.597376 21669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "91cd75cf10964e43badda4d74723ed86" is_pre_election: true
I20260811 07:17:05.597493 21669 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3a1a4cc9ff64abd8a9e7753a34096c5 in term 1.
I20260811 07:17:05.597663 21314 leader_election.cc:302] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91cd75cf10964e43badda4d74723ed86, b3a1a4cc9ff64abd8a9e7753a34096c5; no voters: 3f8823b7fd0d4052bc83b47b9bae3fdf
I20260811 07:17:05.597791 22542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 07:17:05.597853 22542 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f8823b7fd0d4052bc83b47b9bae3fdf)
I20260811 07:17:05.597869 22553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.594576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:46257 (local address 127.0.0.1:53542)
0811 07:17:05.594706 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.594715 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:05.594768 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:05.594984 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:05.594985 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:05.594987 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:05.595034 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.595036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.595970 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.595971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.596874 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.596877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.597600 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.597601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.597684 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.597688 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:05.597759 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 07:17:05.597799 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":2,"thread_start_us":55,"threads_started":1}
I20260811 07:17:05.597895 22542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:17:05.597903 22556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.594710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53542 (local address 127.9.142.189:46257)
0811 07:17:05.594845 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:05.594847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:05.594854 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:17:05.594875 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:05.594876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:05.594885 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:05.594957 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:05.595112 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.595871 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.596934 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.597499 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.597580 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.597593 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:05.597768 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 07:17:05.597812 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":85,"threads_started":1}
I20260811 07:17:05.598104 21360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "91cd75cf10964e43badda4d74723ed86" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" is_pre_election: true
I20260811 07:17:05.598718 22542 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } }
I20260811 07:17:05.598860 21360 raft_consensus.cc:2379] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91cd75cf10964e43badda4d74723ed86 in current term 2: Already voted for candidate b3a1a4cc9ff64abd8a9e7753a34096c5 in this term.
I20260811 07:17:05.598891 22542 leader_election.cc:288] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [CANDIDATE]: Term 2 election: Requested vote from peers 3f8823b7fd0d4052bc83b47b9bae3fdf (127.9.142.190:42895), 91cd75cf10964e43badda4d74723ed86 (127.9.142.188:36097)
I20260811 07:17:05.599052 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.598959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55798)
0811 07:17:05.599001 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.599025 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 07:17:05.599056 21633 leader_election.cc:302] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91cd75cf10964e43badda4d74723ed86; no voters: 3f8823b7fd0d4052bc83b47b9bae3fdf, b3a1a4cc9ff64abd8a9e7753a34096c5
I20260811 07:17:05.599129 21669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "91cd75cf10964e43badda4d74723ed86"
I20260811 07:17:05.599187 21669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:17:05.599320 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.599255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55802)
0811 07:17:05.599283 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.599301 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 07:17:05.599381 21311 leader_election.cc:334] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f8823b7fd0d4052bc83b47b9bae3fdf (127.9.142.190:42895): Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
I20260811 07:17:05.599995 21669 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3a1a4cc9ff64abd8a9e7753a34096c5 in term 2.
I20260811 07:17:05.600111 22552 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:17:05.600220 21314 leader_election.cc:302] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91cd75cf10964e43badda4d74723ed86, b3a1a4cc9ff64abd8a9e7753a34096c5; no voters: 3f8823b7fd0d4052bc83b47b9bae3fdf
I20260811 07:17:05.600343 22542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:17:05.600493 22542 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [term 2 LEADER]: Becoming Leader. State: Replica: b3a1a4cc9ff64abd8a9e7753a34096c5, State: Running, Role: LEADER
I20260811 07:17:05.600608 22542 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } }
I20260811 07:17:05.600965 22559 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3a1a4cc9ff64abd8a9e7753a34096c5. Latest consensus state: current_term: 2 leader_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:05.601076 22559 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:05.601267 22561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:17:05.601686 22561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:17:05.601786 22561 catalog_manager.cc:1259] Loaded cluster ID: 54274404cc7841ef8a22ac91dd2a23f1
I20260811 07:17:05.601838 22561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:17:05.602010 22561 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:17:05.602111 22561 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Loaded TSK: 0
I20260811 07:17:05.602257 22561 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:17:05.609483 21344 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53532:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:17:05.611243 21344 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:17:05.612247 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.612159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55820)
0811 07:17:05.612189 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.612221 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260811 07:17:05.612283 21669 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [term 2 FOLLOWER]: Refusing update from remote peer b3a1a4cc9ff64abd8a9e7753a34096c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 07:17:05.612550 22559 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 07:17:05.612668 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.612560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55826)
0811 07:17:05.612615 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.612644 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 07:17:05.612735 21311 consensus_peers.cc:487] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 -> Peer 3f8823b7fd0d4052bc83b47b9bae3fdf (127.9.142.190:42895): Couldn't send request to peer 3f8823b7fd0d4052bc83b47b9bae3fdf. Status: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 07:17:05.613253 22552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3a1a4cc9ff64abd8a9e7753a34096c5. Latest consensus state: current_term: 2 leader_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:05.613353 22552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:17:05.613786 22542 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:05.613885 22542 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:05.614640 22552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "3f8823b7fd0d4052bc83b47b9bae3fdf" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42895 } } peers { permanent_uuid: "b3a1a4cc9ff64abd8a9e7753a34096c5" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 46257 } attrs { promote: false } } peers { permanent_uuid: "91cd75cf10964e43badda4d74723ed86" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36097 } attrs { promote: false } } }
I20260811 07:17:05.614744 22552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cd75cf10964e43badda4d74723ed86 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:17:05.619203 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.615813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:36411 (local address 127.0.0.1:39160)
0811 07:17:05.616020 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.616031 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:05.616081 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:05.616354 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:05.616356 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:05.616360 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:05.616531 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.616534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.617495 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.617495 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.618284 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.618285 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.618957 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.618959 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.619025 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.619029 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:05.619071 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 07:17:05.619119 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":70}
I20260811 07:17:05.619513 22573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.615914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:45575 (local address 127.0.0.1:50620)
0811 07:17:05.616152 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.616163 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:05.616239 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:05.616400 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:05.616401 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:05.616403 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:05.616505 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.616507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.617368 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.617368 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.618505 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.618508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.619264 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.619265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.619340 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.619345 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:17:05.619390 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 07:17:05.619432 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":2,"thread_start_us":70,"threads_started":1}
I20260811 07:17:05.619518 22574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.615969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39160 (local address 127.9.142.130:36411)
0811 07:17:05.616202 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:05.616204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:05.616212 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:05.616243 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:05.616244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:05.616255 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:05.616322 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:05.616659 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.617416 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.618370 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.618874 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.619251 (+ 377us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.619272 (+ 21us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:05.619295 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 07:17:05.619442 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":90,"threads_started":1}
I20260811 07:17:05.619735 22092 tablet_service.cc:1467] Processing CreateTablet for tablet 552dc500eb484086b1360583d8e69866 (DEFAULT_TABLE table=test-table [id=cb6e06cedad44367a57a4fc9655bea79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:05.619798 22575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.616042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50620 (local address 127.9.142.131:45575)
0811 07:17:05.616145 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:05.616147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:05.616298 (+ 151us) server_negotiation.cc:407] Connection header received
0811 07:17:05.616328 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:05.616329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:05.616340 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:05.616399 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:05.616561 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.617300 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.618595 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.619150 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.619217 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.619227 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:05.619653 (+ 426us) server_negotiation.cc:299] Negotiation successful
0811 07:17:05.619701 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":49,"threads_started":1}
I20260811 07:17:05.619899 22092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 552dc500eb484086b1360583d8e69866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:05.620009 22314 tablet_service.cc:1467] Processing CreateTablet for tablet 552dc500eb484086b1360583d8e69866 (DEFAULT_TABLE table=test-table [id=cb6e06cedad44367a57a4fc9655bea79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:05.620121 22314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 552dc500eb484086b1360583d8e69866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:05.620344 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.615699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33611 (local address 127.0.0.1:57492)
0811 07:17:05.615764 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.615777 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:05.615826 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:05.617249 (+ 1423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:05.617250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:05.617251 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:05.617298 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.617299 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.618248 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.618250 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.619267 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:05.619269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.620093 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.620094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:05.620157 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.620161 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:05.620245 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 07:17:05.620284 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 07:17:05.620368 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.615810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57492 (local address 127.9.142.129:33611)
0811 07:17:05.617100 (+ 1290us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:05.617103 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:05.617112 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:05.617141 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:05.617142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:05.617154 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:05.617389 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:05.617436 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.618159 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.619356 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:05.619992 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:05.620090 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:05.620103 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:05.620253 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 07:17:05.620297 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1265,"thread_start_us":74,"threads_started":1}
I20260811 07:17:05.620594 21844 tablet_service.cc:1467] Processing CreateTablet for tablet 552dc500eb484086b1360583d8e69866 (DEFAULT_TABLE table=test-table [id=cb6e06cedad44367a57a4fc9655bea79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:05.620705 21844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 552dc500eb484086b1360583d8e69866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:05.621531 22578 tablet_bootstrap.cc:492] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: Bootstrap starting.
I20260811 07:17:05.622071 22578 tablet_bootstrap.cc:654] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:05.622087 22579 tablet_bootstrap.cc:492] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: Bootstrap starting.
I20260811 07:17:05.622413 22579 tablet_bootstrap.cc:654] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:05.622557 22580 tablet_bootstrap.cc:492] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc: Bootstrap starting.
I20260811 07:17:05.622697 22578 tablet_bootstrap.cc:492] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: No bootstrap required, opened a new log
I20260811 07:17:05.622774 22578 ts_tablet_manager.cc:1397] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:05.622897 22578 raft_consensus.cc:348] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:05.623000 22580 tablet_bootstrap.cc:654] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:05.623006 22578 raft_consensus.cc:374] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:05.623042 22578 raft_consensus.cc:729] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73f895fa3e67477a9ac1ff0df1c30d74, State: Initialized, Role: FOLLOWER
I20260811 07:17:05.623116 22578 consensus_queue.cc:260] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:05.623272 22578 ts_tablet_manager.cc:1428] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:05.623869 22593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.623625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.130:51027)
0811 07:17:05.623795 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.623834 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":88,"threads_started":1}
I20260811 07:17:05.624188 22579 tablet_bootstrap.cc:492] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: No bootstrap required, opened a new log
I20260811 07:17:05.624221 22205 heartbeater.cc:503] Master 127.9.142.189:46257 was elected leader, sending a full tablet report...
I20260811 07:17:05.624478 22580 tablet_bootstrap.cc:492] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc: No bootstrap required, opened a new log
I20260811 07:17:05.624532 22580 ts_tablet_manager.cc:1397] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:17:05.624682 22580 raft_consensus.cc:348] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:05.624770 22580 raft_consensus.cc:374] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:05.624786 22580 raft_consensus.cc:729] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86748627d0a1448cb659320148462ddc, State: Initialized, Role: FOLLOWER
I20260811 07:17:05.624843 22580 consensus_queue.cc:260] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:05.625032 22580 ts_tablet_manager.cc:1428] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:05.624259 22579 ts_tablet_manager.cc:1397] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:17:05.625223 22579 raft_consensus.cc:348] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:05.625430 22579 raft_consensus.cc:374] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:05.625479 22579 raft_consensus.cc:729] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840521325ce34ce186c304c939f5b744, State: Initialized, Role: FOLLOWER
I20260811 07:17:05.625543 22579 consensus_queue.cc:260] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:05.625772 22579 ts_tablet_manager.cc:1428] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:17:05.625412 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.625199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.129:54701)
0811 07:17:05.625331 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.625372 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":84,"threads_started":1}
I20260811 07:17:05.626052 21973 heartbeater.cc:503] Master 127.9.142.189:46257 was elected leader, sending a full tablet report...
I20260811 07:17:05.626209 22426 heartbeater.cc:503] Master 127.9.142.189:46257 was elected leader, sending a full tablet report...
I20260811 07:17:05.626314 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.626202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.129:58719)
0811 07:17:05.626261 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.626289 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 07:17:05.626839 22599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.625864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.131:49597)
0811 07:17:05.626731 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.626812 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":844,"thread_start_us":82,"threads_started":1}
I20260811 07:17:05.627122 22599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.627057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.131:59511)
0811 07:17:05.627089 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.627110 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 07:17:05.653862 22428 tablet.cc:2369] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:17:05.972304 22589 raft_consensus.cc:482] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:17:05.972494 22589 raft_consensus.cc:504] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:05.972709 22589 leader_election.cc:288] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86748627d0a1448cb659320148462ddc (127.9.142.129:33611), 840521325ce34ce186c304c939f5b744 (127.9.142.131:45575)
I20260811 07:17:05.973116 21877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "552dc500eb484086b1360583d8e69866" candidate_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86748627d0a1448cb659320148462ddc" is_pre_election: true
I20260811 07:17:05.973136 22349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "552dc500eb484086b1360583d8e69866" candidate_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840521325ce34ce186c304c939f5b744" is_pre_election: true
I20260811 07:17:05.973281 22349 raft_consensus.cc:2454] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73f895fa3e67477a9ac1ff0df1c30d74 in term 0.
I20260811 07:17:05.973284 21877 raft_consensus.cc:2454] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73f895fa3e67477a9ac1ff0df1c30d74 in term 0.
I20260811 07:17:05.973531 22017 leader_election.cc:302] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73f895fa3e67477a9ac1ff0df1c30d74, 840521325ce34ce186c304c939f5b744; no voters:
I20260811 07:17:05.973662 22589 raft_consensus.cc:2781] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:17:05.973841 22589 raft_consensus.cc:482] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:17:05.973907 22589 raft_consensus.cc:3037] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:05.974798 22589 raft_consensus.cc:504] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:05.974982 22589 leader_election.cc:288] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [CANDIDATE]: Term 1 election: Requested vote from peers 86748627d0a1448cb659320148462ddc (127.9.142.129:33611), 840521325ce34ce186c304c939f5b744 (127.9.142.131:45575)
I20260811 07:17:05.975261 21877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "552dc500eb484086b1360583d8e69866" candidate_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86748627d0a1448cb659320148462ddc"
I20260811 07:17:05.975262 22349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "552dc500eb484086b1360583d8e69866" candidate_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840521325ce34ce186c304c939f5b744"
I20260811 07:17:05.975358 21877 raft_consensus.cc:3037] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:05.975373 22349 raft_consensus.cc:3037] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:05.976233 22349 raft_consensus.cc:2454] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73f895fa3e67477a9ac1ff0df1c30d74 in term 1.
I20260811 07:17:05.976233 21877 raft_consensus.cc:2454] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73f895fa3e67477a9ac1ff0df1c30d74 in term 1.
I20260811 07:17:05.976466 22017 leader_election.cc:302] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73f895fa3e67477a9ac1ff0df1c30d74, 840521325ce34ce186c304c939f5b744; no voters:
I20260811 07:17:05.976655 22589 raft_consensus.cc:2781] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:05.976822 22589 raft_consensus.cc:686] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 LEADER]: Becoming Leader. State: Replica: 73f895fa3e67477a9ac1ff0df1c30d74, State: Running, Role: LEADER
I20260811 07:17:05.976879 22589 consensus_queue.cc:237] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } }
I20260811 07:17:05.977196 22593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:05.977081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.130:55695)
0811 07:17:05.977122 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:05.977154 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 07:17:05.977660 21342 catalog_manager.cc:5495] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73f895fa3e67477a9ac1ff0df1c30d74 (127.9.142.130). New cstate: current_term: 1 leader_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73f895fa3e67477a9ac1ff0df1c30d74" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 } health_report { overall_health: UNKNOWN } } }
I20260811 07:17:06.061141 22574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:06.058359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39164 (local address 127.9.142.130:36411)
0811 07:17:06.058490 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:06.058492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:06.058510 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:17:06.058551 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:06.058553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:06.058567 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:06.058660 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:06.058918 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:06.059451 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:06.060319 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:06.060545 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:06.060619 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:06.060785 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:06.060816 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:06.060858 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:06.060969 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 07:17:06.061000 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 07:17:06.062315 21877 raft_consensus.cc:1261] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [term 1 FOLLOWER]: Refusing update from remote peer 73f895fa3e67477a9ac1ff0df1c30d74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:06.062311 22349 raft_consensus.cc:1261] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [term 1 FOLLOWER]: Refusing update from remote peer 73f895fa3e67477a9ac1ff0df1c30d74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:06.062556 22589 consensus_queue.cc:1035] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "840521325ce34ce186c304c939f5b744" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 45575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:06.062678 22600 consensus_queue.cc:1035] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86748627d0a1448cb659320148462ddc" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:06.063439 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:06.063261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.129:48521)
0811 07:17:06.063364 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:06.063402 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 07:17:06.064476 22599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:06.064228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.131:49533)
0811 07:17:06.064349 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:06.064420 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 07:17:06.064931 22593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:06.064796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.130:56143)
0811 07:17:06.064857 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:06.064894 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 07:17:06.065225 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:06.065125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.129:33905)
0811 07:17:06.065169 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:06.065194 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 07:17:06.065779 22599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:06.065684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.9.142.131:48909)
0811 07:17:06.065722 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:06.065748 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 07:17:06.067214 21342 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:06.067302 21342 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:06.068717 21342 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b3a1a4cc9ff64abd8a9e7753a34096c5: Sending DeleteTablet for 3 replicas of tablet 552dc500eb484086b1360583d8e69866
I20260811 07:17:06.069020 21844 tablet_service.cc:1514] Processing DeleteTablet for tablet 552dc500eb484086b1360583d8e69866 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:06 UTC) from {username='oryx', principal='oryx/127.9.142.189@KRBTEST.COM'} at 127.0.0.1:57492
I20260811 07:17:06.069103 22314 tablet_service.cc:1514] Processing DeleteTablet for tablet 552dc500eb484086b1360583d8e69866 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:06 UTC) from {username='oryx', principal='oryx/127.9.142.189@KRBTEST.COM'} at 127.0.0.1:50620
I20260811 07:17:06.069103 22092 tablet_service.cc:1514] Processing DeleteTablet for tablet 552dc500eb484086b1360583d8e69866 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:06 UTC) from {username='oryx', principal='oryx/127.9.142.189@KRBTEST.COM'} at 127.0.0.1:39160
I20260811 07:17:06.069268 22619 tablet_replica.cc:330] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc: stopping tablet replica
I20260811 07:17:06.069355 22619 raft_consensus.cc:2229] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:06.069413 22619 raft_consensus.cc:2258] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:06.069582 22623 tablet_replica.cc:330] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: stopping tablet replica
I20260811 07:17:06.069653 22623 raft_consensus.cc:2229] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:06.069707 22623 raft_consensus.cc:2258] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:06.069722 22619 ts_tablet_manager.cc:1905] T 552dc500eb484086b1360583d8e69866 P 86748627d0a1448cb659320148462ddc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:06.069809 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 21599
I20260811 07:17:06.069883 22624 tablet_replica.cc:330] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: stopping tablet replica
I20260811 07:17:06.069965 22624 raft_consensus.cc:2229] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:17:06.070047 22624 raft_consensus.cc:2258] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:06.070544 22624 ts_tablet_manager.cc:1905] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:06.072986 22624 ts_tablet_manager.cc:1918] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:06.073081 22624 log.cc:1196] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/552dc500eb484086b1360583d8e69866
I20260811 07:17:06.073359 22624 ts_tablet_manager.cc:1939] T 552dc500eb484086b1360583d8e69866 P 73f895fa3e67477a9ac1ff0df1c30d74: Deleting consensus metadata
I20260811 07:17:06.073695 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:06.073579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55842)
0811 07:17:06.073626 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:06.073656 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 07:17:06.073846 21311 catalog_manager.cc:4841] TS 73f895fa3e67477a9ac1ff0df1c30d74 (127.9.142.130:36411): tablet 552dc500eb484086b1360583d8e69866 (table test-table [id=cb6e06cedad44367a57a4fc9655bea79]) successfully deleted
I20260811 07:17:06.074193 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:06.074080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42895 (local address 127.0.0.1:55848)
0811 07:17:06.074136 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:06.074162 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:42895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 07:17:06.076993 22623 ts_tablet_manager.cc:1905] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:06.078343 22623 ts_tablet_manager.cc:1918] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:06.078426 22623 log.cc:1196] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/552dc500eb484086b1360583d8e69866
I20260811 07:17:06.078673 22623 ts_tablet_manager.cc:1939] T 552dc500eb484086b1360583d8e69866 P 840521325ce34ce186c304c939f5b744: Deleting consensus metadata
I20260811 07:17:06.079046 21311 catalog_manager.cc:4841] TS 840521325ce34ce186c304c939f5b744 (127.9.142.131:45575): tablet 552dc500eb484086b1360583d8e69866 (table test-table [id=cb6e06cedad44367a57a4fc9655bea79]) successfully deleted
I20260811 07:17:06.081552 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:06.081426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33611 (local address 127.0.0.1:57508)
0811 07:17:06.081483 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:06.081514 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 07:17:06.081761 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 21983
W20260811 07:17:06.081745 21311 catalog_manager.cc:4584] TS 86748627d0a1448cb659320148462ddc (127.9.142.129:33611): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 552dc500eb484086b1360583d8e69866: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33611: connect: Connection refused (error 111)
I20260811 07:17:06.099280 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 22216
I20260811 07:17:06.114602 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 21107
I20260811 07:17:06.128860 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 21434
2026-08-11T07:17:06Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5355 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:17:06 dist-test-slave-7f01 krb5kdc[22632](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:17:06 dist-test-slave-7f01 krb5kdc[22632](info): set up 2 sockets
Aug 11 07:17:06 dist-test-slave-7f01 krb5kdc[22632](info): commencing operation
krb5kdc: starting...
W20260811 07:17:07.449144 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:17:07 dist-test-slave-7f01 krb5kdc[22632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:17:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:17:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.190.keytab.
Entry for principal oryx/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.190.keytab.
I20260811 07:17:07.588828 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:36083
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.190.keytab
--principal=oryx/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:36083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:07.682248 22652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:07.682516 22652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:07.682556 22652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:07.683776 22652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:07.683851 22652 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:17:07.683873 22652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:07.683897 22652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:07.683924 22652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:07.683962 22652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:07.686159 22652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:36083
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.190.keytab
--principal=oryx/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:36083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:07.686667 22652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:07.687026 22652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:07.692898 22659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:07.692898 22664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:07.692926 22660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:07.693284 22652 server_base.cc:1034] running on GCE node
I20260811 07:17:07.693548 22652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:07.693823 22652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:07.694984 22652 hybrid_clock.cc:648] HybridClock initialized: now 1786432627694975 us; error 50 us; skew 500 ppm
Aug 11 07:17:07 dist-test-slave-7f01 krb5kdc[22632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432627, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:07.697798 22652 init.cc:377] Logged in from keytab as oryx/127.9.142.190@KRBTEST.COM (short username oryx)
I20260811 07:17:07.698338 22652 webserver.cc:460] Webserver started at http://127.9.142.190:33157/ using document root <none> and password file <none>
I20260811 07:17:07.698619 22652 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:07.698696 22652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:07.698858 22652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:07.700071 22652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "0596d79a46704f1ab6130c5f05c1ab33"
format_stamp: "Formatted at 2026-08-11 07:17:07 on dist-test-slave-7f01"
server_key: "b23da703a280c882f11507e8ec989500"
server_key_iv: "27fe11ba600b6639efa59cbdcfe70bfd"
server_key_version: "encryptionkey@0"
I20260811 07:17:07.700460 22652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "0596d79a46704f1ab6130c5f05c1ab33"
format_stamp: "Formatted at 2026-08-11 07:17:07 on dist-test-slave-7f01"
server_key: "b23da703a280c882f11507e8ec989500"
server_key_iv: "27fe11ba600b6639efa59cbdcfe70bfd"
server_key_version: "encryptionkey@0"
I20260811 07:17:07.701920 22652 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:17:07.702943 22672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:07.703176 22652 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:07.703297 22652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "0596d79a46704f1ab6130c5f05c1ab33"
format_stamp: "Formatted at 2026-08-11 07:17:07 on dist-test-slave-7f01"
server_key: "b23da703a280c882f11507e8ec989500"
server_key_iv: "27fe11ba600b6639efa59cbdcfe70bfd"
server_key_version: "encryptionkey@0"
I20260811 07:17:07.703379 22652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:07.719444 22652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:07.722081 22652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:07.722270 22652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:07.728701 22652 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:36083
I20260811 07:17:07.728755 22775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:36083 every 8 connection(s)
I20260811 07:17:07.729156 22652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:17:07.729970 22778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:07.732744 22778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: Bootstrap starting.
I20260811 07:17:07.733467 22778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:07.733795 22778 log.cc:824] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:07.734673 22778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: No bootstrap required, opened a new log
I20260811 07:17:07.736003 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 22652
I20260811 07:17:07.736116 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:17:07.736320 9786 external_mini_cluster.cc:1428] Setting key 98178d2988aae2a8db3f2dc2c6b2bf2a
I20260811 07:17:07.737476 22778 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0596d79a46704f1ab6130c5f05c1ab33" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36083 } }
I20260811 07:17:07.737643 22778 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:07.737689 22778 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0596d79a46704f1ab6130c5f05c1ab33, State: Initialized, Role: FOLLOWER
I20260811 07:17:07.737826 22778 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0596d79a46704f1ab6130c5f05c1ab33" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36083 } }
I20260811 07:17:07.737924 22778 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:17:07.737972 22778 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:17:07.738025 22778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:07.738592 22778 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0596d79a46704f1ab6130c5f05c1ab33" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36083 } }
I20260811 07:17:07.738720 22778 leader_election.cc:302] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0596d79a46704f1ab6130c5f05c1ab33; no voters:
I20260811 07:17:07.738907 22778 leader_election.cc:288] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:17:07.738957 22785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:07.739105 22785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [term 1 LEADER]: Becoming Leader. State: Replica: 0596d79a46704f1ab6130c5f05c1ab33, State: Running, Role: LEADER
I20260811 07:17:07.739180 22778 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:07.739197 22785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0596d79a46704f1ab6130c5f05c1ab33" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36083 } }
I20260811 07:17:07.739531 22785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0596d79a46704f1ab6130c5f05c1ab33. Latest consensus state: current_term: 1 leader_uuid: "0596d79a46704f1ab6130c5f05c1ab33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0596d79a46704f1ab6130c5f05c1ab33" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36083 } } }
I20260811 07:17:07.739811 22785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:07.739542 22786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0596d79a46704f1ab6130c5f05c1ab33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0596d79a46704f1ab6130c5f05c1ab33" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36083 } } }
I20260811 07:17:07.740043 22786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33 [sys.catalog]: This master's current role is: LEADER
W20260811 07:17:07.741220 22814 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:17:07.741281 22814 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:17:07.741325 22796 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:17:07.741482 22796 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:17:07.743086 22796 catalog_manager.cc:1347] Generated new cluster ID: c3d81b6b092e4c06858a0215c07babc5
I20260811 07:17:07.743149 22796 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:17:07 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:07.748903 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:07.736934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60758 (local address 127.9.142.190:36083)
0811 07:17:07.737163 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:07.737171 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:07.737202 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:17:07.737457 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:07.737463 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:07.737511 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:07.737649 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:07.738455 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.739840 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.740870 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.741375 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.741497 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:07.744329 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:07.744333 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:07.744334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:07.744345 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:07.746990 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:07.747355 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:07.747358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:07.747359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:07.747465 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:07.747645 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:07.747646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:07.747646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:07.747952 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:07.748100 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:07.748539 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 07:17:07.748674 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":103,"threads_started":1}
I20260811 07:17:07.749683 22796 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:17:07.750193 22796 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:17:07.761579 22796 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: Generated new TSK 0
I20260811 07:17:07.761792 22796 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab.
Entry for principal oryx/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab.
I20260811 07:17:07.795321 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:36083
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab
--principal=oryx/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:07.893770 22824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:07.894004 22824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:07.894047 22824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:07.895191 22824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:07.895256 22824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:07.895291 22824 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:17:07.895354 22824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:17:07.896973 22824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab
--principal=oryx/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.142.190:36083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:07.897248 22824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:07.897486 22824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:07.902549 22835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:07.902573 22832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:07.902588 22833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:07.902962 22824 server_base.cc:1034] running on GCE node
I20260811 07:17:07.903184 22824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:07.903441 22824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:07.904618 22824 hybrid_clock.cc:648] HybridClock initialized: now 1786432627904602 us; error 30 us; skew 500 ppm
Aug 11 07:17:07 dist-test-slave-7f01 krb5kdc[22632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432627, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:07.907225 22824 init.cc:377] Logged in from keytab as oryx/127.9.142.129@KRBTEST.COM (short username oryx)
I20260811 07:17:07.907722 22824 webserver.cc:460] Webserver started at http://127.9.142.129:42655/ using document root <none> and password file <none>
I20260811 07:17:07.908036 22824 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:07.908109 22824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:07.908314 22824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:07.909390 22824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "16978d942dc24fcca4b730019da99c2c"
format_stamp: "Formatted at 2026-08-11 07:17:07 on dist-test-slave-7f01"
server_key: "014a70dde17f5a2227984fab04588a50"
server_key_iv: "a47dc461f5cee0a3bb98cadffeaa4e76"
server_key_version: "encryptionkey@0"
I20260811 07:17:07.909771 22824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "16978d942dc24fcca4b730019da99c2c"
format_stamp: "Formatted at 2026-08-11 07:17:07 on dist-test-slave-7f01"
server_key: "014a70dde17f5a2227984fab04588a50"
server_key_iv: "a47dc461f5cee0a3bb98cadffeaa4e76"
server_key_version: "encryptionkey@0"
I20260811 07:17:07.911194 22824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:17:07.912092 22848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:07.912276 22824 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:07.912397 22824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "16978d942dc24fcca4b730019da99c2c"
format_stamp: "Formatted at 2026-08-11 07:17:07 on dist-test-slave-7f01"
server_key: "014a70dde17f5a2227984fab04588a50"
server_key_iv: "a47dc461f5cee0a3bb98cadffeaa4e76"
server_key_version: "encryptionkey@0"
I20260811 07:17:07.912477 22824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:07.936905 22824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:07.938824 22824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:07.939010 22824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:07.939679 22824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:07.939782 22824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:07.939852 22824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:07.939873 22824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:17:07 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432627, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:07.947641 22824 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:41367
I20260811 07:17:07.947757 23030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:41367 every 8 connection(s)
I20260811 07:17:07.948144 22824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:17:07.949872 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:07.940153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:42723 (local address 127.9.142.190:36083)
0811 07:17:07.940216 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:07.940218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:07.940445 (+ 227us) server_negotiation.cc:407] Connection header received
0811 07:17:07.940977 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:07.940978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:07.940996 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:07.941074 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:07.941847 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.942693 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.944481 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.944708 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.944791 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:07.947069 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:07.947071 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:07.947071 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:07.947087 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:07.948779 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:07.949132 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:07.949133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:07.949133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:07.949190 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:07.949404 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:07.949405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:07.949405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:07.949499 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:07.949545 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:07.949745 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 07:17:07.949809 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 07:17:07.950098 22864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:07.940162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36083 (local address 127.9.142.129:42723)
0811 07:17:07.940335 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:07.940371 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:07.940871 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:07.941211 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:07.941215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:07.941513 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:07.941749 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:07.941756 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.942824 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.942826 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:07.944355 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:07.944361 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.944816 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.944817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:07.944964 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:07.945501 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:07.945514 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:07.946955 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:07.948848 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:07.948852 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:07.948853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:07.949065 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:07.949259 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:07.949260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:07.949260 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:07.949358 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:07.949549 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:07.949552 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:07.949657 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 07:17:07.949735 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 07:17:07.949849 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
I20260811 07:17:07.950626 23034 heartbeater.cc:347] Connected to a master server at 127.9.142.190:36083
I20260811 07:17:07.950717 23034 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:07.950901 23034 heartbeater.cc:511] Master 127.9.142.190:36083 requested a full tablet report, sending...
I20260811 07:17:07.951733 22694 ts_manager.cc:194] Registered new tserver with Master: 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367)
I20260811 07:17:07.952211 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 22824
I20260811 07:17:07.952323 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:17:07.952554 9786 external_mini_cluster.cc:1428] Setting key 2b605af7cb5570080db265812e72a07a
I20260811 07:17:07.952724 22694 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:42723
I20260811 07:17:07.960286 23045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:07.951932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36083 (local address 127.9.142.129:44575)
0811 07:17:07.952075 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:07.952085 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:07.952165 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:07.952342 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:07.952343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:07.952541 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:07.952624 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:07.952627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.954967 (+ 2340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.954968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:07.955788 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:07.955791 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.956321 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.956322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:07.956393 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:07.956860 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:07.956865 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:07.957298 (+ 433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:07.959239 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:07.959240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:07.959240 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:07.959406 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:07.959627 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:07.959627 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:07.959628 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:07.959681 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:07.960025 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:07.960027 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:07.960076 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 07:17:07.960132 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:17:07.960211 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":849,"threads_started":1}
I20260811 07:17:07.960410 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:07.951885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:44575 (local address 127.9.142.190:36083)
0811 07:17:07.951953 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:07.951954 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:07.952149 (+ 195us) server_negotiation.cc:407] Connection header received
0811 07:17:07.952215 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:07.952216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:07.952226 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:07.952279 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:07.952691 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.953401 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.955906 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:07.956228 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:07.956306 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:07.957396 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:07.957397 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:07.957397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:07.957404 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:07.959150 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:07.959486 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:07.959487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:07.959487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:07.959556 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:07.959783 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:07.959785 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:07.959785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:07.959939 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:07.960031 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:07.960183 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 07:17:07.960273 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":20}
WARNING: no policy specified for oryx/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab.
Entry for principal oryx/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab.
I20260811 07:17:07.982517 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:36083
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab
--principal=oryx/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:08.067778 23053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:08.068014 23053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:08.068053 23053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:08.069195 23053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:08.069264 23053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:08.069303 23053 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:17:08.069360 23053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:17:08.070901 23053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab
--principal=oryx/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.142.190:36083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:08.071175 23053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:08.071409 23053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:08.076541 23063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:08.076575 23064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:08.076548 23067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:08.076865 23053 server_base.cc:1034] running on GCE node
I20260811 07:17:08.077082 23053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:08.077299 23053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:08.078481 23053 hybrid_clock.cc:648] HybridClock initialized: now 1786432628078445 us; error 48 us; skew 500 ppm
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432628, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:08.081291 23053 init.cc:377] Logged in from keytab as oryx/127.9.142.130@KRBTEST.COM (short username oryx)
I20260811 07:17:08.081779 23053 webserver.cc:460] Webserver started at http://127.9.142.130:41663/ using document root <none> and password file <none>
I20260811 07:17:08.082038 23053 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:08.082085 23053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:08.082243 23053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:08.083331 23053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "b491509bc18149c2b4640e87102690c2"
format_stamp: "Formatted at 2026-08-11 07:17:08 on dist-test-slave-7f01"
server_key: "f2a66b260b2cbdee7c474bee86db8c82"
server_key_iv: "922e49320e1eb7d859580d4d7d7b2749"
server_key_version: "encryptionkey@0"
I20260811 07:17:08.083696 23053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "b491509bc18149c2b4640e87102690c2"
format_stamp: "Formatted at 2026-08-11 07:17:08 on dist-test-slave-7f01"
server_key: "f2a66b260b2cbdee7c474bee86db8c82"
server_key_iv: "922e49320e1eb7d859580d4d7d7b2749"
server_key_version: "encryptionkey@0"
I20260811 07:17:08.085142 23053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:08.085963 23079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.086177 23053 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:08.086287 23053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "b491509bc18149c2b4640e87102690c2"
format_stamp: "Formatted at 2026-08-11 07:17:08 on dist-test-slave-7f01"
server_key: "f2a66b260b2cbdee7c474bee86db8c82"
server_key_iv: "922e49320e1eb7d859580d4d7d7b2749"
server_key_version: "encryptionkey@0"
I20260811 07:17:08.086372 23053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:08.105572 23053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:08.107901 23053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:08.108088 23053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:08.108692 23053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:08.108754 23053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.108800 23053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:08.108821 23053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432628, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:08.116340 23053 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:36833
I20260811 07:17:08.116700 23053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:17:08.117193 23269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:36833 every 8 connection(s)
I20260811 07:17:08.117910 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 23053
I20260811 07:17:08.118053 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:17:08.118319 9786 external_mini_cluster.cc:1428] Setting key d88c410c210697c4566d61c4acf1a6a8
I20260811 07:17:08.119254 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.109060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:39545 (local address 127.9.142.190:36083)
0811 07:17:08.109132 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.109134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.109423 (+ 289us) server_negotiation.cc:407] Connection header received
0811 07:17:08.110001 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.110002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.110016 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.110080 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:08.110850 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.111783 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.112893 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.113121 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.113206 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.115644 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:08.115645 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:08.115646 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:08.115655 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:08.117547 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.118109 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.118111 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.118111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.118182 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.118516 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.118517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.118517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.118677 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:08.118776 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.119060 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.119157 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:17:08.119470 23092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.109096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36083 (local address 127.9.142.130:39545)
0811 07:17:08.109277 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.109320 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.109886 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.110156 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.110160 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.110525 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:08.110738 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.110743 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.111889 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.111890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.112768 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.112770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.113229 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.113230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.113389 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.113931 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:08.113940 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:08.115539 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:08.117650 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.117658 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.117660 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.118010 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.118264 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.118265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.118266 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.118426 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.118768 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:08.118774 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:08.118908 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.119033 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.119202 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":94,"threads_started":1}
I20260811 07:17:08.120019 23272 heartbeater.cc:347] Connected to a master server at 127.9.142.190:36083
I20260811 07:17:08.120108 23272 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:08.120321 23272 heartbeater.cc:511] Master 127.9.142.190:36083 requested a full tablet report, sending...
I20260811 07:17:08.120719 22694 ts_manager.cc:194] Registered new tserver with Master: b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833)
I20260811 07:17:08.121255 22694 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:39545
WARNING: no policy specified for oryx/127.9.142.131@KRBTEST.COM; defaulting to no policy
I20260811 07:17:08.128783 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.121308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:39655 (local address 127.9.142.190:36083)
0811 07:17:08.121364 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.121366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.122858 (+ 1492us) server_negotiation.cc:407] Connection header received
0811 07:17:08.122929 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.122930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.122941 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.122995 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:08.123355 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.123948 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.124728 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.124951 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.125040 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.126024 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:08.126026 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:08.126026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:08.126034 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:08.127429 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.127843 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.127845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.127845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.127906 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.128137 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.128138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.128139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.128301 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:08.128394 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.128602 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.128682 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 07:17:08.128813 23286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.121223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36083 (local address 127.9.142.130:39655)
0811 07:17:08.122771 (+ 1548us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.122782 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.122872 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.122999 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.122999 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.123189 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:08.123260 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.123262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.124049 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.124050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.124623 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.124625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.125044 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.125046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.125130 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.125607 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:08.125612 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:08.125926 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:08.127522 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.127523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.127523 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.127711 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.127998 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.127999 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.128000 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.128067 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.128425 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:08.128426 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:08.128487 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.128572 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.128684 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1523,"thread_start_us":76,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab.
Entry for principal oryx/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab.
I20260811 07:17:08.150417 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:36083
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab
--principal=oryx/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:08.242086 23290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:08.242295 23290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:08.242319 23290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:08.243414 23290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:08.243453 23290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:08.243472 23290 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:17:08.243489 23290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:17:08.245008 23290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab
--principal=oryx/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.142.190:36083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:08.245198 23290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:08.245371 23290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:08.250730 23298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:08.250702 23301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:08.250979 23299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:08.251104 23290 server_base.cc:1034] running on GCE node
I20260811 07:17:08.251439 23290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:08.251780 23290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:08.252960 23290 hybrid_clock.cc:648] HybridClock initialized: now 1786432628252936 us; error 39 us; skew 500 ppm
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432628, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:08.255874 23290 init.cc:377] Logged in from keytab as oryx/127.9.142.131@KRBTEST.COM (short username oryx)
I20260811 07:17:08.256351 23290 webserver.cc:460] Webserver started at http://127.9.142.131:39269/ using document root <none> and password file <none>
I20260811 07:17:08.256635 23290 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:08.256707 23290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:08.256870 23290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:08.258064 23290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "edd3e1428b40465b9fc5b363eda8704c"
format_stamp: "Formatted at 2026-08-11 07:17:08 on dist-test-slave-7f01"
server_key: "2445edc46df1d0ae1ba54d567d01ace7"
server_key_iv: "ea0b1c99c6673223d1be291a2e806ae2"
server_key_version: "encryptionkey@0"
I20260811 07:17:08.258574 23290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "edd3e1428b40465b9fc5b363eda8704c"
format_stamp: "Formatted at 2026-08-11 07:17:08 on dist-test-slave-7f01"
server_key: "2445edc46df1d0ae1ba54d567d01ace7"
server_key_iv: "ea0b1c99c6673223d1be291a2e806ae2"
server_key_version: "encryptionkey@0"
I20260811 07:17:08.260310 23290 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 07:17:08.261135 23312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.261341 23290 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:08.261476 23290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "edd3e1428b40465b9fc5b363eda8704c"
format_stamp: "Formatted at 2026-08-11 07:17:08 on dist-test-slave-7f01"
server_key: "2445edc46df1d0ae1ba54d567d01ace7"
server_key_iv: "ea0b1c99c6673223d1be291a2e806ae2"
server_key_version: "encryptionkey@0"
I20260811 07:17:08.261559 23290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:08.287050 23290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:08.289500 23290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:08.289667 23290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:08.290270 23290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:08.290325 23290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.290366 23290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:08.290395 23290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.298067 23290 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:39291
I20260811 07:17:08.298185 23500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:39291 every 8 connection(s)
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432628, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:08.298545 23290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:17:08.301791 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.290907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:59729 (local address 127.9.142.190:36083)
0811 07:17:08.290968 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.290970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.291187 (+ 217us) server_negotiation.cc:407] Connection header received
0811 07:17:08.291793 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.291794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.291809 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.291867 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:08.292857 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.293725 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.295333 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.295685 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.295804 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.298916 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:08.298918 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:08.298918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:08.298926 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:08.300505 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.300920 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.300921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.300922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.300978 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.301233 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.301233 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.301233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.301346 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:08.301391 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.301655 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.301723 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 07:17:08.301987 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.290887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36083 (local address 127.9.142.131:59729)
0811 07:17:08.291062 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.291099 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.291652 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.291944 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.291948 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.292405 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:08.292737 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.292744 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.293843 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.293844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.295251 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.295256 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.295820 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.295821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.295964 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.296548 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:08.296560 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:08.298780 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:08.300601 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.300608 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.300610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.300845 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.301061 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.301062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.301062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.301179 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.301417 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:08.301423 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:08.301545 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.301627 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.301754 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260811 07:17:08.302508 23501 heartbeater.cc:347] Connected to a master server at 127.9.142.190:36083
I20260811 07:17:08.302594 23501 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:08.302802 23501 heartbeater.cc:511] Master 127.9.142.190:36083 requested a full tablet report, sending...
I20260811 07:17:08.303224 22696 ts_manager.cc:194] Registered new tserver with Master: edd3e1428b40465b9fc5b363eda8704c (127.9.142.131:39291)
I20260811 07:17:08.303575 22696 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:59729
I20260811 07:17:08.307281 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 23290
I20260811 07:17:08.307430 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:17:08.307655 9786 external_mini_cluster.cc:1428] Setting key 0e6fc7ee47dbfa84318f677c572b86cd
I20260811 07:17:08.308943 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:17:08.309976 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.303696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:45011 (local address 127.9.142.190:36083)
0811 07:17:08.303761 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.303763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.303906 (+ 143us) server_negotiation.cc:407] Connection header received
0811 07:17:08.303953 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.303954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.303964 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.304025 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:08.304358 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.305057 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.305845 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.306098 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.306175 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.307273 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:08.307274 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:08.307275 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:08.307282 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:08.308771 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.309144 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.309145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.309145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.309212 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.309425 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.309426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.309426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.309545 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:08.309620 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.309791 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.309873 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:17:08.309988 23513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.303650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36083 (local address 127.9.142.131:45011)
0811 07:17:08.303824 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.303834 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.303899 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.304031 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.304032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.304217 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:08.304280 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.304281 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.305184 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.305185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.305724 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.305725 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.306175 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.306176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.306250 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.306791 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:08.306795 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:08.307161 (+ 366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:08.308881 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.308883 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.308883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.309066 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.309283 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.309284 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.309284 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.309350 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.309612 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:08.309613 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:08.309675 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.309762 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.309876 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":70,"threads_started":1}
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432628, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:17:08.339932 22782 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:08.333693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60774 (local address 127.9.142.190:36083)
0811 07:17:08.333787 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.333789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.333798 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:08.333828 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.333829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.333839 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.333893 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:08.334581 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.335111 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.335975 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.336176 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.336244 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.339804 (+ 3560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60774: BlockingRecv error: recv got EOF from 127.0.0.1:60774 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432628, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:08.349431 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.340837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60782 (local address 127.9.142.190:36083)
0811 07:17:08.340934 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.340936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.341045 (+ 109us) server_negotiation.cc:407] Connection header received
0811 07:17:08.341143 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.341144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.341174 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.341226 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:08.341688 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.342187 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.342860 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.343059 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.343116 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.346028 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:08.346029 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:08.346030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:08.346036 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:08.348166 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.348579 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.348580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.348581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.348649 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.348837 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.348838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.348838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.348961 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:08.349043 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.349200 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.349279 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:17:08.351933 22696 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60782:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:17:08.353605 22696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:17:08.360852 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.356768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36782 (local address 127.9.142.130:36833)
0811 07:17:08.357003 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.357009 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.357019 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:17:08.357063 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.357065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.357082 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.357166 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:08.357376 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.358226 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.359560 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.360363 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.360451 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.360540 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.360706 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.360747 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":111,"threads_started":1}
I20260811 07:17:08.360842 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.356348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:36833 (local address 127.0.0.1:36782)
0811 07:17:08.356868 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.356897 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.356967 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.357199 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.357203 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.357206 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:08.357290 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.357293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.358324 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.358325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.359457 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.359460 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.360457 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.360458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.360565 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.360580 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.360684 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.360743 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":24,"thread_start_us":73,"threads_started":1}
I20260811 07:17:08.361183 23536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.356348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:41367 (local address 127.0.0.1:48150)
0811 07:17:08.356555 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.356602 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.356680 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.357620 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.357621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.357623 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:08.357668 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.357669 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.358948 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.358949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.360015 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.360018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.360961 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.360962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.361044 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.361049 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.361078 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.361116 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":61,"threads_started":1}
I20260811 07:17:08.361660 23544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.357013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.9.142.129:41367)
0811 07:17:08.357437 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.357440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.357448 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:08.357513 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.357515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.357530 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.357610 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:08.357724 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.358786 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.360110 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.360846 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.361371 (+ 525us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.361469 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.361508 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.361555 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":135,"threads_started":1}
I20260811 07:17:08.361711 23169 tablet_service.cc:1467] Processing CreateTablet for tablet d4fe24c299b94bd6b23bda38b093050c (DEFAULT_TABLE table=test-table [id=ecd97ddaa21542cd8384b382dc75e6b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:08.362143 23169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4fe24c299b94bd6b23bda38b093050c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.362226 23539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.356583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:39291 (local address 127.0.0.1:43602)
0811 07:17:08.357244 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.357254 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.357317 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.357517 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.357517 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.357519 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:08.357574 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.357576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.358861 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.358862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.360153 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.360156 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.361584 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.361585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.361652 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.361657 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.362102 (+ 445us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.362152 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":36,"thread_start_us":88,"threads_started":1}
I20260811 07:17:08.362505 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.356716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43602 (local address 127.9.142.131:39291)
0811 07:17:08.356897 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.356902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.357319 (+ 417us) server_negotiation.cc:407] Connection header received
0811 07:17:08.357407 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.357410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.357429 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.357504 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:08.357665 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.358761 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.360242 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.361412 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.361479 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.361547 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.362126 (+ 579us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.362168 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20260811 07:17:08.362383 22925 tablet_service.cc:1467] Processing CreateTablet for tablet d4fe24c299b94bd6b23bda38b093050c (DEFAULT_TABLE table=test-table [id=ecd97ddaa21542cd8384b382dc75e6b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:08.362754 22925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4fe24c299b94bd6b23bda38b093050c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.363073 23395 tablet_service.cc:1467] Processing CreateTablet for tablet d4fe24c299b94bd6b23bda38b093050c (DEFAULT_TABLE table=test-table [id=ecd97ddaa21542cd8384b382dc75e6b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:08.363408 23395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4fe24c299b94bd6b23bda38b093050c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.366756 23547 tablet_bootstrap.cc:492] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: Bootstrap starting.
I20260811 07:17:08.367004 23548 tablet_bootstrap.cc:492] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: Bootstrap starting.
I20260811 07:17:08.367614 23547 tablet_bootstrap.cc:654] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.367676 23548 tablet_bootstrap.cc:654] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.368053 23547 log.cc:824] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:08.368067 23548 log.cc:824] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:08.368431 23551 tablet_bootstrap.cc:492] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: Bootstrap starting.
I20260811 07:17:08.368963 23548 tablet_bootstrap.cc:492] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: No bootstrap required, opened a new log
I20260811 07:17:08.369058 23548 ts_tablet_manager.cc:1397] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:17:08.369091 23551 tablet_bootstrap.cc:654] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.369215 23547 tablet_bootstrap.cc:492] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: No bootstrap required, opened a new log
I20260811 07:17:08.369331 23547 ts_tablet_manager.cc:1397] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:17:08.369419 23551 log.cc:824] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:08.370285 23551 tablet_bootstrap.cc:492] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: No bootstrap required, opened a new log
I20260811 07:17:08.370361 23551 ts_tablet_manager.cc:1397] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:17:08.371243 23547 raft_consensus.cc:348] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.371436 23547 raft_consensus.cc:374] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.371487 23547 raft_consensus.cc:729] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd3e1428b40465b9fc5b363eda8704c, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.371251 23548 raft_consensus.cc:348] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.371548 23548 raft_consensus.cc:374] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.371619 23547 consensus_queue.cc:260] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.371665 23548 raft_consensus.cc:729] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b491509bc18149c2b4640e87102690c2, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.371853 23548 consensus_queue.cc:260] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.372033 23547 ts_tablet_manager.cc:1428] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 07:17:08.372192 23501 heartbeater.cc:503] Master 127.9.142.190:36083 was elected leader, sending a full tablet report...
I20260811 07:17:08.372207 23548 ts_tablet_manager.cc:1428] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:17:08.372378 23272 heartbeater.cc:503] Master 127.9.142.190:36083 was elected leader, sending a full tablet report...
I20260811 07:17:08.372782 23551 raft_consensus.cc:348] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.372967 23551 raft_consensus.cc:374] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.373011 23551 raft_consensus.cc:729] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16978d942dc24fcca4b730019da99c2c, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.373132 23551 consensus_queue.cc:260] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.373478 23551 ts_tablet_manager.cc:1428] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:17:08.373494 23034 heartbeater.cc:503] Master 127.9.142.190:36083 was elected leader, sending a full tablet report...
W20260811 07:17:08.449038 23035 tablet.cc:2369] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:17:08.460075 23558 raft_consensus.cc:482] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:17:08.460261 23558 raft_consensus.cc:504] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.460775 23558 leader_election.cc:288] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833), 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367)
I20260811 07:17:08.464535 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.461053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:36833 (local address 127.9.142.131:47839)
0811 07:17:08.461143 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.461159 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.461243 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.461432 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.461433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.461435 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:08.461525 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.461527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.462247 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.462248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.463022 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.463025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.464023 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.464024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.464242 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.464248 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.464384 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.464444 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":2}
I20260811 07:17:08.464550 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.461154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:47839 (local address 127.9.142.130:36833)
0811 07:17:08.461228 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.461231 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.461244 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:17:08.461309 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.461310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.461323 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.461421 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:08.461613 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.462154 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.463130 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.463892 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.464030 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.464046 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.464399 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.464469 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 07:17:08.465262 23544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.461186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:33971 (local address 127.9.142.129:41367)
0811 07:17:08.461236 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.461239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.461552 (+ 313us) server_negotiation.cc:407] Connection header received
0811 07:17:08.461648 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.461649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.461658 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.461710 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:08.461900 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.462526 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.463940 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.464753 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.464874 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.464884 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.465165 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.465206 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:17:08.465293 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.461063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:41367 (local address 127.9.142.131:33971)
0811 07:17:08.461422 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.461436 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.461570 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.461713 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.461714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.461715 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:08.461815 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.461816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.462626 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.462627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.463662 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.463672 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.464926 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.464927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.465044 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.465048 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.465143 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.465186 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":157,"thread_start_us":130,"threads_started":1}
I20260811 07:17:08.465266 23205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4fe24c299b94bd6b23bda38b093050c" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b491509bc18149c2b4640e87102690c2" is_pre_election: true
I20260811 07:17:08.465533 23205 raft_consensus.cc:2454] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 0.
I20260811 07:17:08.465907 23315 leader_election.cc:302] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b491509bc18149c2b4640e87102690c2, edd3e1428b40465b9fc5b363eda8704c; no voters:
I20260811 07:17:08.465958 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4fe24c299b94bd6b23bda38b093050c" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16978d942dc24fcca4b730019da99c2c" is_pre_election: true
I20260811 07:17:08.466058 23558 raft_consensus.cc:2781] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:17:08.466120 23558 raft_consensus.cc:482] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:17:08.466140 23558 raft_consensus.cc:3037] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:08.466143 22953 raft_consensus.cc:2454] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 0.
I20260811 07:17:08.467340 23558 raft_consensus.cc:504] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.467521 23558 leader_election.cc:288] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 election: Requested vote from peers b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833), 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367)
I20260811 07:17:08.467695 23205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4fe24c299b94bd6b23bda38b093050c" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b491509bc18149c2b4640e87102690c2"
I20260811 07:17:08.467854 23205 raft_consensus.cc:3037] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:08.467900 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4fe24c299b94bd6b23bda38b093050c" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16978d942dc24fcca4b730019da99c2c"
I20260811 07:17:08.468024 22953 raft_consensus.cc:3037] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:08.468871 23205 raft_consensus.cc:2454] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 1.
I20260811 07:17:08.469009 22953 raft_consensus.cc:2454] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 1.
I20260811 07:17:08.469202 23315 leader_election.cc:302] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b491509bc18149c2b4640e87102690c2, edd3e1428b40465b9fc5b363eda8704c; no voters:
I20260811 07:17:08.469331 23558 raft_consensus.cc:2781] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:08.469583 23558 raft_consensus.cc:686] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 1 LEADER]: Becoming Leader. State: Replica: edd3e1428b40465b9fc5b363eda8704c, State: Running, Role: LEADER
I20260811 07:17:08.469707 23558 consensus_queue.cc:237] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.470747 22691 catalog_manager.cc:5495] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c reported cstate change: term changed from 0 to 1, leader changed from <none> to edd3e1428b40465b9fc5b363eda8704c (127.9.142.131). New cstate: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } health_report { overall_health: HEALTHY } } }
I20260811 07:17:08.478093 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.475416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43618 (local address 127.9.142.131:39291)
0811 07:17:08.475471 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.475474 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.475485 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:17:08.475566 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.475567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.475594 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.475675 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:08.475849 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.476369 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.477224 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.477458 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.477542 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.477728 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:08.477841 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:08.477945 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.477978 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.478001 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 07:17:08.480199 22953 raft_consensus.cc:1261] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Refusing update from remote peer edd3e1428b40465b9fc5b363eda8704c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:08.480238 23205 raft_consensus.cc:1261] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Refusing update from remote peer edd3e1428b40465b9fc5b363eda8704c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:08.480598 23558 consensus_queue.cc:1035] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:08.480777 23562 consensus_queue.cc:1035] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:08.483644 23569 mvcc.cc:205] Tried to move back new op lower bound from 7317228046251139072 to 7317228046212730880. Current Snapshot: MvccSnapshot[applied={T|T < 7317228046251139072}]
I20260811 07:17:08.484328 23566 mvcc.cc:205] Tried to move back new op lower bound from 7317228046251139072 to 7317228046212730880. Current Snapshot: MvccSnapshot[applied={T|T < 7317228046251139072}]
I20260811 07:17:08.486057 22696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:08.486163 22696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:08.487035 22696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: Sending DeleteTablet for 3 replicas of tablet d4fe24c299b94bd6b23bda38b093050c
I20260811 07:17:08.487390 23169 tablet_service.cc:1514] Processing DeleteTablet for tablet d4fe24c299b94bd6b23bda38b093050c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:08 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:36782
I20260811 07:17:08.487449 22925 tablet_service.cc:1514] Processing DeleteTablet for tablet d4fe24c299b94bd6b23bda38b093050c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:08 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:48150
I20260811 07:17:08.487726 23579 tablet_replica.cc:330] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: stopping tablet replica
I20260811 07:17:08.487739 23395 tablet_service.cc:1514] Processing DeleteTablet for tablet d4fe24c299b94bd6b23bda38b093050c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:08 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:43602
I20260811 07:17:08.487895 23579 raft_consensus.cc:2229] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:08.487999 22696 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60782:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:17:08.488154 22696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:17:08.488662 23580 tablet_replica.cc:330] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: stopping tablet replica
I20260811 07:17:08.489238 23580 raft_consensus.cc:2229] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:08.489612 23169 tablet_service.cc:1467] Processing CreateTablet for tablet 3ee0ecfc2d844eb38dcadf384ce6cddf (DEFAULT_TABLE table=test-table [id=b2faae0e70514b5d98a41d3e9e8aac95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:08.489032 23579 raft_consensus.cc:2258] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:08.489568 22925 tablet_service.cc:1467] Processing CreateTablet for tablet 3ee0ecfc2d844eb38dcadf384ce6cddf (DEFAULT_TABLE table=test-table [id=b2faae0e70514b5d98a41d3e9e8aac95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:08.489763 23169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ee0ecfc2d844eb38dcadf384ce6cddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.489795 22925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ee0ecfc2d844eb38dcadf384ce6cddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.489737 23395 tablet_service.cc:1467] Processing CreateTablet for tablet 3ee0ecfc2d844eb38dcadf384ce6cddf (DEFAULT_TABLE table=test-table [id=b2faae0e70514b5d98a41d3e9e8aac95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:08.489894 23395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ee0ecfc2d844eb38dcadf384ce6cddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.491371 23551 tablet_bootstrap.cc:492] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: Bootstrap starting.
I20260811 07:17:08.491394 23547 tablet_bootstrap.cc:492] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: Bootstrap starting.
I20260811 07:17:08.491505 23548 tablet_bootstrap.cc:492] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: Bootstrap starting.
I20260811 07:17:08.491869 23551 tablet_bootstrap.cc:654] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.491909 23547 tablet_bootstrap.cc:654] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.492003 23548 tablet_bootstrap.cc:654] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.492596 23547 tablet_bootstrap.cc:492] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: No bootstrap required, opened a new log
I20260811 07:17:08.492642 23547 ts_tablet_manager.cc:1397] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:08.492841 23547 raft_consensus.cc:348] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.492950 23547 raft_consensus.cc:374] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.492969 23547 raft_consensus.cc:729] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd3e1428b40465b9fc5b363eda8704c, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.493039 23547 consensus_queue.cc:260] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.493149 23547 ts_tablet_manager.cc:1428] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.493549 23580 raft_consensus.cc:2258] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:08.494091 23579 ts_tablet_manager.cc:1905] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:08.495791 23581 tablet_replica.cc:330] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: stopping tablet replica
I20260811 07:17:08.495841 23579 ts_tablet_manager.cc:1918] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:08.495891 23551 tablet_bootstrap.cc:492] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: No bootstrap required, opened a new log
I20260811 07:17:08.495918 23581 raft_consensus.cc:2229] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:17:08.495936 23579 log.cc:1196] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/d4fe24c299b94bd6b23bda38b093050c
I20260811 07:17:08.495951 23551 ts_tablet_manager.cc:1397] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 07:17:08.496031 23581 raft_consensus.cc:2258] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:08.496234 23580 ts_tablet_manager.cc:1905] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:08.496357 23579 ts_tablet_manager.cc:1939] T d4fe24c299b94bd6b23bda38b093050c P 16978d942dc24fcca4b730019da99c2c: Deleting consensus metadata
I20260811 07:17:08.496435 23581 ts_tablet_manager.cc:1905] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:08.496368 23551 raft_consensus.cc:348] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.496507 23551 raft_consensus.cc:374] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.496541 23551 raft_consensus.cc:729] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16978d942dc24fcca4b730019da99c2c, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.496594 23551 consensus_queue.cc:260] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.496740 23551 ts_tablet_manager.cc:1428] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:08.496912 22677 catalog_manager.cc:4841] TS 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367): tablet d4fe24c299b94bd6b23bda38b093050c (table test-table [id=ecd97ddaa21542cd8384b382dc75e6b5]) successfully deleted
I20260811 07:17:08.497730 23548 tablet_bootstrap.cc:492] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: No bootstrap required, opened a new log
I20260811 07:17:08.497783 23548 ts_tablet_manager.cc:1397] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 07:17:08.497963 23548 raft_consensus.cc:348] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.498062 23548 raft_consensus.cc:374] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.498086 23548 raft_consensus.cc:729] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b491509bc18149c2b4640e87102690c2, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.498140 23548 consensus_queue.cc:260] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.498179 23581 ts_tablet_manager.cc:1918] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:08.498238 23548 ts_tablet_manager.cc:1428] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.498248 23581 log.cc:1196] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/d4fe24c299b94bd6b23bda38b093050c
I20260811 07:17:08.498373 23580 ts_tablet_manager.cc:1918] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:08.498450 23580 log.cc:1196] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/d4fe24c299b94bd6b23bda38b093050c
I20260811 07:17:08.498546 23581 ts_tablet_manager.cc:1939] T d4fe24c299b94bd6b23bda38b093050c P edd3e1428b40465b9fc5b363eda8704c: Deleting consensus metadata
I20260811 07:17:08.498751 23580 ts_tablet_manager.cc:1939] T d4fe24c299b94bd6b23bda38b093050c P b491509bc18149c2b4640e87102690c2: Deleting consensus metadata
I20260811 07:17:08.498944 22677 catalog_manager.cc:4841] TS edd3e1428b40465b9fc5b363eda8704c (127.9.142.131:39291): tablet d4fe24c299b94bd6b23bda38b093050c (table test-table [id=ecd97ddaa21542cd8384b382dc75e6b5]) successfully deleted
I20260811 07:17:08.499226 22676 catalog_manager.cc:4841] TS b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833): tablet d4fe24c299b94bd6b23bda38b093050c (table test-table [id=ecd97ddaa21542cd8384b382dc75e6b5]) successfully deleted
W20260811 07:17:08.549153 23502 tablet.cc:2369] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:17:08.575421 23560 raft_consensus.cc:482] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:17:08.575569 23560 raft_consensus.cc:504] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.575994 23560 leader_election.cc:288] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833), edd3e1428b40465b9fc5b363eda8704c (127.9.142.131:39291)
I20260811 07:17:08.579461 23542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.576339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:51221 (local address 127.9.142.130:36833)
0811 07:17:08.576408 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.576411 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.576422 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:17:08.576541 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.576542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.576554 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.576632 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:08.576817 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.577588 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.578671 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.579062 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.579137 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.579149 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.579339 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.579385 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:17:08.579470 23586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.576193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:36833 (local address 127.9.142.129:51221)
0811 07:17:08.576338 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.576351 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.576430 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.576634 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.576635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.576637 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:08.576729 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.576732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.577708 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.577709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.578570 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.578573 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.579150 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.579151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.579249 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.579255 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.579319 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.579363 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":24,"thread_start_us":67,"threads_started":1}
I20260811 07:17:08.579885 23205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ee0ecfc2d844eb38dcadf384ce6cddf" candidate_uuid: "16978d942dc24fcca4b730019da99c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b491509bc18149c2b4640e87102690c2" is_pre_election: true
I20260811 07:17:08.579998 23205 raft_consensus.cc:2454] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16978d942dc24fcca4b730019da99c2c in term 0.
I20260811 07:17:08.580003 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.576412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:43635 (local address 127.9.142.131:39291)
0811 07:17:08.576459 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.576461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.576547 (+ 86us) server_negotiation.cc:407] Connection header received
0811 07:17:08.576605 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.576606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.576618 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.576666 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:08.576852 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.577592 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.579067 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.579625 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.579697 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.579706 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.579889 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.579934 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:17:08.580101 23588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.576195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:39291 (local address 127.9.142.129:43635)
0811 07:17:08.576482 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.576492 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.576543 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.576707 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.576709 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.576711 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:08.576786 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.576788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.577698 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.577699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.578965 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.578969 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.579721 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.579722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.579818 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.579822 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.579878 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.579920 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":65,"thread_start_us":62,"threads_started":1}
I20260811 07:17:08.580211 22851 leader_election.cc:302] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16978d942dc24fcca4b730019da99c2c, b491509bc18149c2b4640e87102690c2; no voters:
I20260811 07:17:08.580345 23560 raft_consensus.cc:2781] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:17:08.580384 23560 raft_consensus.cc:482] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:17:08.580404 23560 raft_consensus.cc:3037] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:08.580439 23424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ee0ecfc2d844eb38dcadf384ce6cddf" candidate_uuid: "16978d942dc24fcca4b730019da99c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd3e1428b40465b9fc5b363eda8704c" is_pre_election: true
I20260811 07:17:08.580561 23424 raft_consensus.cc:2454] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16978d942dc24fcca4b730019da99c2c in term 0.
I20260811 07:17:08.581238 23560 raft_consensus.cc:504] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.581394 23560 leader_election.cc:288] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [CANDIDATE]: Term 1 election: Requested vote from peers b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833), edd3e1428b40465b9fc5b363eda8704c (127.9.142.131:39291)
I20260811 07:17:08.581557 23205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ee0ecfc2d844eb38dcadf384ce6cddf" candidate_uuid: "16978d942dc24fcca4b730019da99c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b491509bc18149c2b4640e87102690c2"
I20260811 07:17:08.581583 23424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ee0ecfc2d844eb38dcadf384ce6cddf" candidate_uuid: "16978d942dc24fcca4b730019da99c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd3e1428b40465b9fc5b363eda8704c"
I20260811 07:17:08.581658 23205 raft_consensus.cc:3037] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:08.581663 23424 raft_consensus.cc:3037] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:08.582401 23205 raft_consensus.cc:2454] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16978d942dc24fcca4b730019da99c2c in term 1.
I20260811 07:17:08.582549 22851 leader_election.cc:302] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16978d942dc24fcca4b730019da99c2c, b491509bc18149c2b4640e87102690c2; no voters:
I20260811 07:17:08.582569 23424 raft_consensus.cc:2454] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16978d942dc24fcca4b730019da99c2c in term 1.
I20260811 07:17:08.582732 23560 raft_consensus.cc:2781] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:08.582962 23560 raft_consensus.cc:686] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 1 LEADER]: Becoming Leader. State: Replica: 16978d942dc24fcca4b730019da99c2c, State: Running, Role: LEADER
I20260811 07:17:08.583047 23560 consensus_queue.cc:237] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.583912 22696 catalog_manager.cc:5495] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 16978d942dc24fcca4b730019da99c2c (127.9.142.129). New cstate: current_term: 1 leader_uuid: "16978d942dc24fcca4b730019da99c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } health_report { overall_health: UNKNOWN } } }
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432627, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.190@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:08.617470 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.608897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60790 (local address 127.9.142.190:36083)
0811 07:17:08.608975 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.608978 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.609159 (+ 181us) server_negotiation.cc:407] Connection header received
0811 07:17:08.609264 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.609264 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.609280 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.609342 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:08.610130 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.610641 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.611359 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.611695 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.611947 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.614715 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:08.614719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:08.614719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:08.614731 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:08.616193 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.616590 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.616591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.616591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.616649 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.616850 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.616851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.616851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.616995 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:08.617073 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.617240 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.617354 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 07:17:08.617570 23273 tablet.cc:2369] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:17:08.617573 23598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.608871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36083 (local address 127.0.0.1:60790)
0811 07:17:08.609062 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.609073 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.609180 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.609360 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.609361 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.609937 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:08.610001 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.610005 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.610732 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.610733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.611263 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.611264 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.611953 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.611954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.612032 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.612762 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:08.612767 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:08.614602 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:08.616281 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.616289 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.616291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.616497 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.616718 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:08.616719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:08.616719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:08.616777 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:08.617075 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:08.617083 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:08.617129 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.617216 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.617442 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":91,"thread_start_us":95,"threads_started":1}
I20260811 07:17:08.619867 22696 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:60790:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:17:08.620182 22696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:17:08.621989 23395 tablet_service.cc:1467] Processing CreateTablet for tablet 9ba0d8395a0446b8aa94da2e69b0dc34 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8dc1ee0e5d6348e09b794e0697ba7c0a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:17:08.622162 23395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ba0d8395a0446b8aa94da2e69b0dc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.622139 22925 tablet_service.cc:1467] Processing CreateTablet for tablet 9ba0d8395a0446b8aa94da2e69b0dc34 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8dc1ee0e5d6348e09b794e0697ba7c0a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:17:08.622301 22925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ba0d8395a0446b8aa94da2e69b0dc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.623566 23551 tablet_bootstrap.cc:492] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: Bootstrap starting.
I20260811 07:17:08.624019 23547 tablet_bootstrap.cc:492] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: Bootstrap starting.
I20260811 07:17:08.624089 23551 tablet_bootstrap.cc:654] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.624166 23169 tablet_service.cc:1467] Processing CreateTablet for tablet 9ba0d8395a0446b8aa94da2e69b0dc34 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8dc1ee0e5d6348e09b794e0697ba7c0a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:17:08.624300 23169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ba0d8395a0446b8aa94da2e69b0dc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.624379 23547 tablet_bootstrap.cc:654] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.625041 23551 tablet_bootstrap.cc:492] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: No bootstrap required, opened a new log
I20260811 07:17:08.625101 23551 ts_tablet_manager.cc:1397] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:17:08.625273 23551 raft_consensus.cc:348] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.625363 23551 raft_consensus.cc:374] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.625393 23551 raft_consensus.cc:729] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16978d942dc24fcca4b730019da99c2c, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.625437 23551 consensus_queue.cc:260] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.625538 23551 ts_tablet_manager.cc:1428] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.625681 23560 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.625723 23548 tablet_bootstrap.cc:492] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: Bootstrap starting.
I20260811 07:17:08.625762 23560 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:17:08.626077 23547 tablet_bootstrap.cc:492] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: No bootstrap required, opened a new log
I20260811 07:17:08.626128 23547 ts_tablet_manager.cc:1397] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:17:08.626158 23548 tablet_bootstrap.cc:654] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.626241 23547 raft_consensus.cc:348] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.626313 23547 raft_consensus.cc:374] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.626350 23547 raft_consensus.cc:729] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd3e1428b40465b9fc5b363eda8704c, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.626406 23547 consensus_queue.cc:260] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.626519 23547 ts_tablet_manager.cc:1428] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.626571 23558 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.626631 23558 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:17:08.626858 23548 tablet_bootstrap.cc:492] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: No bootstrap required, opened a new log
I20260811 07:17:08.626905 23548 ts_tablet_manager.cc:1397] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:08.627038 23548 raft_consensus.cc:348] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.627117 23548 raft_consensus.cc:374] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.627136 23548 raft_consensus.cc:729] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b491509bc18149c2b4640e87102690c2, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.627175 23548 consensus_queue.cc:260] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.627264 23548 ts_tablet_manager.cc:1428] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:08.627345 23559 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.627435 23559 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:17:08.814229 23558 raft_consensus.cc:482] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:17:08.814338 23558 raft_consensus.cc:504] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.814579 23558 leader_election.cc:288] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367), b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833)
I20260811 07:17:08.814890 23205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba0d8395a0446b8aa94da2e69b0dc34" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b491509bc18149c2b4640e87102690c2" is_pre_election: true
I20260811 07:17:08.814891 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba0d8395a0446b8aa94da2e69b0dc34" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16978d942dc24fcca4b730019da99c2c" is_pre_election: true
I20260811 07:17:08.815021 23205 raft_consensus.cc:2454] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 0.
I20260811 07:17:08.815021 22953 raft_consensus.cc:2454] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 0.
I20260811 07:17:08.815182 23316 leader_election.cc:302] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16978d942dc24fcca4b730019da99c2c, edd3e1428b40465b9fc5b363eda8704c; no voters:
I20260811 07:17:08.815328 23558 raft_consensus.cc:2781] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:17:08.815380 23558 raft_consensus.cc:482] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:17:08.815409 23558 raft_consensus.cc:3037] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:08.816253 23558 raft_consensus.cc:504] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.816414 23558 leader_election.cc:288] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 election: Requested vote from peers 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367), b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833)
I20260811 07:17:08.816587 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba0d8395a0446b8aa94da2e69b0dc34" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16978d942dc24fcca4b730019da99c2c"
I20260811 07:17:08.816677 22953 raft_consensus.cc:3037] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:08.816639 23205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba0d8395a0446b8aa94da2e69b0dc34" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b491509bc18149c2b4640e87102690c2"
I20260811 07:17:08.816766 23205 raft_consensus.cc:3037] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:08.817341 22953 raft_consensus.cc:2454] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 1.
I20260811 07:17:08.817534 23316 leader_election.cc:302] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16978d942dc24fcca4b730019da99c2c, edd3e1428b40465b9fc5b363eda8704c; no voters:
I20260811 07:17:08.817535 23205 raft_consensus.cc:2454] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 1.
I20260811 07:17:08.817657 23558 raft_consensus.cc:2781] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:08.817724 23558 raft_consensus.cc:686] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [term 1 LEADER]: Becoming Leader. State: Replica: edd3e1428b40465b9fc5b363eda8704c, State: Running, Role: LEADER
I20260811 07:17:08.817780 23558 consensus_queue.cc:237] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.818125 23562 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: TxnStatusTablet state changed. Reason: New leader edd3e1428b40465b9fc5b363eda8704c. Latest consensus state: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.818204 23562 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:17:08.818377 23604 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:17:08.818521 23604 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:17:08.818588 22696 catalog_manager.cc:5495] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c reported cstate change: term changed from 0 to 1, leader changed from <none> to edd3e1428b40465b9fc5b363eda8704c (127.9.142.131). New cstate: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } health_report { overall_health: HEALTHY } } }
I20260811 07:17:08.856122 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.853647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43628 (local address 127.9.142.131:39291)
0811 07:17:08.853720 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.853722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.853734 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:17:08.853840 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.853841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.853853 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.853925 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:08.854082 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.854572 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.855339 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.855541 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.855631 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.855840 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:08.855883 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:08.855947 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.856014 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.856036 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:17:08.856129 23598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.853534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:39291 (local address 127.0.0.1:43628)
0811 07:17:08.853646 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.853684 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.853747 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.853937 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.853937 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.853939 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:17:08.853999 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.854002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.854661 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.854662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.855246 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.855247 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.855632 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.855633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.855698 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.855722 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:17:08.855955 (+ 233us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:17:08.855966 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.856012 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.856060 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 07:17:08.857432 22953 raft_consensus.cc:1261] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Refusing update from remote peer edd3e1428b40465b9fc5b363eda8704c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:08.857424 23205 raft_consensus.cc:1261] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Refusing update from remote peer edd3e1428b40465b9fc5b363eda8704c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:08.857690 23562 consensus_queue.cc:1035] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:08.857859 23558 consensus_queue.cc:1035] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:08.858475 23560 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: TxnStatusTablet state changed. Reason: New leader edd3e1428b40465b9fc5b363eda8704c. Latest consensus state: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.858582 23560 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:17:08.858791 23559 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: TxnStatusTablet state changed. Reason: New leader edd3e1428b40465b9fc5b363eda8704c. Latest consensus state: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.858899 23559 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:17:08.859354 23558 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.859472 23558 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:17:08.859551 23565 mvcc.cc:205] Tried to move back new op lower bound from 7317228047797981184 to 7317228047638237184. Current Snapshot: MvccSnapshot[applied={T|T < 7317228047797981184}]
I20260811 07:17:08.859722 23572 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.859817 23572 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P edd3e1428b40465b9fc5b363eda8704c: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:17:08.860431 23559 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.860518 23559 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P b491509bc18149c2b4640e87102690c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:17:08.860841 23560 tablet_replica.cc:439] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } } }
I20260811 07:17:08.860944 23560 tablet_replica.cc:442] T 9ba0d8395a0446b8aa94da2e69b0dc34 P 16978d942dc24fcca4b730019da99c2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:17:08.864257 23544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.861322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48158 (local address 127.9.142.129:41367)
0811 07:17:08.861360 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.861362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.861370 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:08.861411 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.861412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.861432 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.861532 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:08.861671 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.862245 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.863321 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.863603 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.863674 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.863880 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:08.863990 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:08.864048 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.864115 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.864133 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:17:08.869838 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.867182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:35141 (local address 127.9.142.131:39291)
0811 07:17:08.867346 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.867349 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.867391 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:17:08.867481 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.867482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.867493 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.867567 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:08.867726 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.868323 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.869113 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.869318 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.869394 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.869580 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:08.869615 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:08.869678 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.869741 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.869765 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260811 07:17:08.869884 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.867034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:39291 (local address 127.9.142.129:35141)
0811 07:17:08.867329 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.867342 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.867410 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.867573 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.867574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.867575 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:17:08.867652 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.867653 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.868413 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.868414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.869007 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.869010 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.869395 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.869396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.869479 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.869495 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:17:08.869696 (+ 201us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:17:08.869698 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.869741 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.869786 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260811 07:17:08.872329 23424 raft_consensus.cc:1261] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Refusing update from remote peer 16978d942dc24fcca4b730019da99c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:08.872586 23205 raft_consensus.cc:1261] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Refusing update from remote peer 16978d942dc24fcca4b730019da99c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:08.872646 23589 consensus_queue.cc:1035] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:08.872762 23560 consensus_queue.cc:1035] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:08.881798 23628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.878923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:41367 (local address 127.9.142.131:60541)
0811 07:17:08.879085 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:08.879096 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:08.879158 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:08.879290 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:08.879291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:08.879292 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:17:08.879331 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.879332 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.880103 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.880104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.880981 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:08.880984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.881422 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.881423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:08.881472 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.881486 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:17:08.881668 (+ 182us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:17:08.881669 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 07:17:08.881703 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 07:17:08.881740 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260811 07:17:08.881803 23544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.878962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:60541 (local address 127.9.142.129:41367)
0811 07:17:08.879017 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.879020 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.879196 (+ 176us) server_negotiation.cc:407] Connection header received
0811 07:17:08.879221 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.879222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.879233 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.879287 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:08.879369 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.880023 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.881071 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.881344 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.881426 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.881567 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:08.881603 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:08.881663 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.881709 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.881732 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 07:17:08.891894 22696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:08.892019 22696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:08.892701 22696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: Sending DeleteTablet for 3 replicas of tablet 3ee0ecfc2d844eb38dcadf384ce6cddf
I20260811 07:17:08.892956 22925 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ee0ecfc2d844eb38dcadf384ce6cddf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:08 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:48150
I20260811 07:17:08.893074 23579 tablet_replica.cc:330] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: stopping tablet replica
I20260811 07:17:08.893049 23169 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ee0ecfc2d844eb38dcadf384ce6cddf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:08 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:36782
I20260811 07:17:08.893127 23579 raft_consensus.cc:2229] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:17:08.893152 23580 tablet_replica.cc:330] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: stopping tablet replica
I20260811 07:17:08.893203 23395 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ee0ecfc2d844eb38dcadf384ce6cddf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:08 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:43602
I20260811 07:17:08.893224 23580 raft_consensus.cc:2229] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:08.893241 23579 raft_consensus.cc:2258] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:08.893266 23580 raft_consensus.cc:2258] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:08.893288 23581 tablet_replica.cc:330] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: stopping tablet replica
I20260811 07:17:08.893332 23581 raft_consensus.cc:2229] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:08.893374 23581 raft_consensus.cc:2258] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:08.893651 23580 ts_tablet_manager.cc:1905] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:08.893839 23581 ts_tablet_manager.cc:1905] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:08.895381 23580 ts_tablet_manager.cc:1918] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:17:08.895442 23580 log.cc:1196] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/3ee0ecfc2d844eb38dcadf384ce6cddf
I20260811 07:17:08.895478 23581 ts_tablet_manager.cc:1918] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:17:08.895537 23581 log.cc:1196] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/3ee0ecfc2d844eb38dcadf384ce6cddf
I20260811 07:17:08.895673 23580 ts_tablet_manager.cc:1939] T 3ee0ecfc2d844eb38dcadf384ce6cddf P b491509bc18149c2b4640e87102690c2: Deleting consensus metadata
I20260811 07:17:08.895797 23581 ts_tablet_manager.cc:1939] T 3ee0ecfc2d844eb38dcadf384ce6cddf P edd3e1428b40465b9fc5b363eda8704c: Deleting consensus metadata
I20260811 07:17:08.896162 23579 ts_tablet_manager.cc:1905] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:08.896211 22676 catalog_manager.cc:4841] TS b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833): tablet 3ee0ecfc2d844eb38dcadf384ce6cddf (table test-table [id=b2faae0e70514b5d98a41d3e9e8aac95]) successfully deleted
I20260811 07:17:08.897815 23579 ts_tablet_manager.cc:1918] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:17:08.897886 23579 log.cc:1196] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/3ee0ecfc2d844eb38dcadf384ce6cddf
I20260811 07:17:08.898118 23579 ts_tablet_manager.cc:1939] T 3ee0ecfc2d844eb38dcadf384ce6cddf P 16978d942dc24fcca4b730019da99c2c: Deleting consensus metadata
I20260811 07:17:08.898464 22677 catalog_manager.cc:4841] TS edd3e1428b40465b9fc5b363eda8704c (127.9.142.131:39291): tablet 3ee0ecfc2d844eb38dcadf384ce6cddf (table test-table [id=b2faae0e70514b5d98a41d3e9e8aac95]) successfully deleted
I20260811 07:17:08.898537 22677 catalog_manager.cc:4841] TS 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367): tablet 3ee0ecfc2d844eb38dcadf384ce6cddf (table test-table [id=b2faae0e70514b5d98a41d3e9e8aac95]) successfully deleted
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:17:08.931988 22782 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:08.924480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60806 (local address 127.9.142.190:36083)
0811 07:17:08.924537 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.924540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.924723 (+ 183us) server_negotiation.cc:407] Connection header received
0811 07:17:08.924791 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.924792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.924806 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.924878 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:08.925632 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.926523 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.927581 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.927951 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.928032 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.931906 (+ 3874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60806: BlockingRecv error: recv got EOF from 127.0.0.1:60806 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 07:17:08 dist-test-slave-7f01 krb5kdc[22632](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM
I20260811 07:17:08.942766 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:08.933247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60810 (local address 127.9.142.190:36083)
0811 07:17:08.933288 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:08.933290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:08.933544 (+ 254us) server_negotiation.cc:407] Connection header received
0811 07:17:08.933611 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:08.933611 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:08.933623 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:08.933687 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:08.934358 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.935056 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.936222 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:08.936516 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:08.936600 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:08.939639 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:08.939640 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:08.939640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:08.939650 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:08.941461 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.941878 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.941879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.941879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.941950 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:08.942181 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:08.942182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:08.942182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:08.942335 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:08.942444 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:08.942582 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 07:17:08.942672 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:17:08.944633 22696 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60810:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:17:08.944825 22696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:17:08.946323 23395 tablet_service.cc:1467] Processing CreateTablet for tablet 4ea315bafbe4429fa7d94c80173e8faa (DEFAULT_TABLE table=test-table [id=84b788dc25dc43ebbee5e14d0b70d769]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:08.946357 22925 tablet_service.cc:1467] Processing CreateTablet for tablet 4ea315bafbe4429fa7d94c80173e8faa (DEFAULT_TABLE table=test-table [id=84b788dc25dc43ebbee5e14d0b70d769]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:08.946480 23395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ea315bafbe4429fa7d94c80173e8faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.946498 22925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ea315bafbe4429fa7d94c80173e8faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.948081 23551 tablet_bootstrap.cc:492] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: Bootstrap starting.
I20260811 07:17:08.948590 23551 tablet_bootstrap.cc:654] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.951803 23547 tablet_bootstrap.cc:492] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: Bootstrap starting.
I20260811 07:17:08.952169 23547 tablet_bootstrap.cc:654] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.953230 23169 tablet_service.cc:1467] Processing CreateTablet for tablet 4ea315bafbe4429fa7d94c80173e8faa (DEFAULT_TABLE table=test-table [id=84b788dc25dc43ebbee5e14d0b70d769]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:08.953287 23547 tablet_bootstrap.cc:492] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: No bootstrap required, opened a new log
I20260811 07:17:08.953339 23547 ts_tablet_manager.cc:1397] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:17:08.953378 23169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ea315bafbe4429fa7d94c80173e8faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:08.953459 23547 raft_consensus.cc:348] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.953531 23547 raft_consensus.cc:374] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.953555 23547 raft_consensus.cc:729] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd3e1428b40465b9fc5b363eda8704c, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.953600 23547 consensus_queue.cc:260] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.953686 23547 ts_tablet_manager.cc:1428] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:08.954633 23548 tablet_bootstrap.cc:492] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: Bootstrap starting.
I20260811 07:17:08.955061 23548 tablet_bootstrap.cc:654] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:08.955862 23548 tablet_bootstrap.cc:492] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: No bootstrap required, opened a new log
I20260811 07:17:08.955919 23548 ts_tablet_manager.cc:1397] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:08.956079 23548 raft_consensus.cc:348] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.956158 23548 raft_consensus.cc:374] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.956176 23548 raft_consensus.cc:729] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b491509bc18149c2b4640e87102690c2, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.956215 23548 consensus_queue.cc:260] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.956225 23551 tablet_bootstrap.cc:492] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: No bootstrap required, opened a new log
I20260811 07:17:08.956279 23551 ts_tablet_manager.cc:1397] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20260811 07:17:08.956287 23548 ts_tablet_manager.cc:1428] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 07:17:08.956422 23551 raft_consensus.cc:348] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.956487 23551 raft_consensus.cc:374] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:08.956507 23551 raft_consensus.cc:729] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16978d942dc24fcca4b730019da99c2c, State: Initialized, Role: FOLLOWER
I20260811 07:17:08.956552 23551 consensus_queue.cc:260] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:08.956632 23551 ts_tablet_manager.cc:1428] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:09.132863 23562 raft_consensus.cc:482] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:17:09.132994 23562 raft_consensus.cc:504] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.133224 23562 leader_election.cc:288] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367), b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833)
I20260811 07:17:09.133541 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ea315bafbe4429fa7d94c80173e8faa" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16978d942dc24fcca4b730019da99c2c" is_pre_election: true
I20260811 07:17:09.133543 23205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ea315bafbe4429fa7d94c80173e8faa" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b491509bc18149c2b4640e87102690c2" is_pre_election: true
I20260811 07:17:09.133663 22953 raft_consensus.cc:2454] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 0.
I20260811 07:17:09.133662 23205 raft_consensus.cc:2454] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 0.
I20260811 07:17:09.133821 23316 leader_election.cc:302] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16978d942dc24fcca4b730019da99c2c, edd3e1428b40465b9fc5b363eda8704c; no voters:
I20260811 07:17:09.133937 23562 raft_consensus.cc:2781] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:17:09.133981 23562 raft_consensus.cc:482] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:17:09.134004 23562 raft_consensus.cc:3037] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:09.134794 23562 raft_consensus.cc:504] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.134953 23562 leader_election.cc:288] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 election: Requested vote from peers 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367), b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833)
I20260811 07:17:09.135160 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ea315bafbe4429fa7d94c80173e8faa" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16978d942dc24fcca4b730019da99c2c"
I20260811 07:17:09.135257 22953 raft_consensus.cc:3037] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:09.135187 23205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ea315bafbe4429fa7d94c80173e8faa" candidate_uuid: "edd3e1428b40465b9fc5b363eda8704c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b491509bc18149c2b4640e87102690c2"
I20260811 07:17:09.135288 23205 raft_consensus.cc:3037] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:09.136024 22953 raft_consensus.cc:2454] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 1.
I20260811 07:17:09.136053 23205 raft_consensus.cc:2454] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edd3e1428b40465b9fc5b363eda8704c in term 1.
I20260811 07:17:09.136245 23316 leader_election.cc:302] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16978d942dc24fcca4b730019da99c2c, edd3e1428b40465b9fc5b363eda8704c; no voters:
I20260811 07:17:09.136368 23562 raft_consensus.cc:2781] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:09.136441 23562 raft_consensus.cc:686] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 1 LEADER]: Becoming Leader. State: Replica: edd3e1428b40465b9fc5b363eda8704c, State: Running, Role: LEADER
I20260811 07:17:09.136502 23562 consensus_queue.cc:237] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.137130 22696 catalog_manager.cc:5495] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c reported cstate change: term changed from 0 to 1, leader changed from <none> to edd3e1428b40465b9fc5b363eda8704c (127.9.142.131). New cstate: current_term: 1 leader_uuid: "edd3e1428b40465b9fc5b363eda8704c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } health_report { overall_health: HEALTHY } } }
I20260811 07:17:09.187140 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.184316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43640 (local address 127.9.142.131:39291)
0811 07:17:09.184410 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:09.184413 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:09.184423 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:17:09.184573 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:09.184574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:09.184585 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:09.184639 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:09.184878 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.185469 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.186371 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.186576 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.186639 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.186846 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:09.186875 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:09.186914 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:09.187010 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 07:17:09.187027 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:17:09.188153 22953 raft_consensus.cc:1261] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Refusing update from remote peer edd3e1428b40465b9fc5b363eda8704c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:09.188153 23205 raft_consensus.cc:1261] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Refusing update from remote peer edd3e1428b40465b9fc5b363eda8704c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:09.188426 23562 consensus_queue.cc:1035] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:09.188566 23558 consensus_queue.cc:1035] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:09.191692 22696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:09.191843 22696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:09.192525 22696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: Sending DeleteTablet for 3 replicas of tablet 4ea315bafbe4429fa7d94c80173e8faa
I20260811 07:17:09.192788 23169 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea315bafbe4429fa7d94c80173e8faa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:09 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:36782
I20260811 07:17:09.192890 23580 tablet_replica.cc:330] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: stopping tablet replica
I20260811 07:17:09.192832 23395 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea315bafbe4429fa7d94c80173e8faa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:09 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:43602
I20260811 07:17:09.192946 23580 raft_consensus.cc:2229] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:09.192968 23581 tablet_replica.cc:330] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: stopping tablet replica
I20260811 07:17:09.192999 23580 raft_consensus.cc:2258] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:09.193017 23581 raft_consensus.cc:2229] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:17:09.193089 23581 raft_consensus.cc:2258] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:09.193145 22696 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60810:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 07:17:09.193243 22925 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea315bafbe4429fa7d94c80173e8faa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:09 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:48150
W20260811 07:17:09.193300 22696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:17:09.193341 23579 tablet_replica.cc:330] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: stopping tablet replica
I20260811 07:17:09.193369 23580 ts_tablet_manager.cc:1905] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:09.193405 23579 raft_consensus.cc:2229] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:09.193452 23579 raft_consensus.cc:2258] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:09.193806 23579 ts_tablet_manager.cc:1905] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:09.194582 23395 tablet_service.cc:1467] Processing CreateTablet for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed (DEFAULT_TABLE table=test-table [id=4a5fc441fe6c4ee7bc6637a58c687df9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:09.194607 22925 tablet_service.cc:1467] Processing CreateTablet for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed (DEFAULT_TABLE table=test-table [id=4a5fc441fe6c4ee7bc6637a58c687df9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:09.194722 23395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:09.194723 22925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:09.195078 23580 ts_tablet_manager.cc:1918] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:09.195133 23580 log.cc:1196] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/4ea315bafbe4429fa7d94c80173e8faa
I20260811 07:17:09.195354 23580 ts_tablet_manager.cc:1939] T 4ea315bafbe4429fa7d94c80173e8faa P b491509bc18149c2b4640e87102690c2: Deleting consensus metadata
I20260811 07:17:09.195604 23579 ts_tablet_manager.cc:1918] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:09.195667 23579 log.cc:1196] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/4ea315bafbe4429fa7d94c80173e8faa
I20260811 07:17:09.195912 23579 ts_tablet_manager.cc:1939] T 4ea315bafbe4429fa7d94c80173e8faa P 16978d942dc24fcca4b730019da99c2c: Deleting consensus metadata
I20260811 07:17:09.196180 23547 tablet_bootstrap.cc:492] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: Bootstrap starting.
I20260811 07:17:09.196235 22677 catalog_manager.cc:4841] TS 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367): tablet 4ea315bafbe4429fa7d94c80173e8faa (table test-table [id=84b788dc25dc43ebbee5e14d0b70d769]) successfully deleted
I20260811 07:17:09.196257 23551 tablet_bootstrap.cc:492] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c: Bootstrap starting.
I20260811 07:17:09.196292 23581 ts_tablet_manager.cc:1905] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:09.196535 23551 tablet_bootstrap.cc:654] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:09.196535 23547 tablet_bootstrap.cc:654] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:09.196952 22676 catalog_manager.cc:4841] TS b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833): tablet 4ea315bafbe4429fa7d94c80173e8faa (table test-table [id=84b788dc25dc43ebbee5e14d0b70d769]) successfully deleted
I20260811 07:17:09.197124 23169 tablet_service.cc:1467] Processing CreateTablet for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed (DEFAULT_TABLE table=test-table [id=4a5fc441fe6c4ee7bc6637a58c687df9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:09.197238 23169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:09.197239 23551 tablet_bootstrap.cc:492] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c: No bootstrap required, opened a new log
I20260811 07:17:09.197283 23551 ts_tablet_manager.cc:1397] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:17:09.197417 23551 raft_consensus.cc:348] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.197491 23551 raft_consensus.cc:374] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:09.197510 23551 raft_consensus.cc:729] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16978d942dc24fcca4b730019da99c2c, State: Initialized, Role: FOLLOWER
I20260811 07:17:09.197551 23551 consensus_queue.cc:260] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.197615 23581 ts_tablet_manager.cc:1918] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:09.197646 23551 ts_tablet_manager.cc:1428] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:09.197672 23581 log.cc:1196] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/4ea315bafbe4429fa7d94c80173e8faa
I20260811 07:17:09.197875 23581 ts_tablet_manager.cc:1939] T 4ea315bafbe4429fa7d94c80173e8faa P edd3e1428b40465b9fc5b363eda8704c: Deleting consensus metadata
I20260811 07:17:09.198227 22677 catalog_manager.cc:4841] TS edd3e1428b40465b9fc5b363eda8704c (127.9.142.131:39291): tablet 4ea315bafbe4429fa7d94c80173e8faa (table test-table [id=84b788dc25dc43ebbee5e14d0b70d769]) successfully deleted
I20260811 07:17:09.198565 23548 tablet_bootstrap.cc:492] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: Bootstrap starting.
I20260811 07:17:09.198740 23547 tablet_bootstrap.cc:492] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: No bootstrap required, opened a new log
I20260811 07:17:09.198798 23547 ts_tablet_manager.cc:1397] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260811 07:17:09.198931 23547 raft_consensus.cc:348] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.199000 23547 raft_consensus.cc:374] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:09.198977 23548 tablet_bootstrap.cc:654] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:09.199016 23547 raft_consensus.cc:729] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd3e1428b40465b9fc5b363eda8704c, State: Initialized, Role: FOLLOWER
I20260811 07:17:09.199069 23547 consensus_queue.cc:260] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.199168 23547 ts_tablet_manager.cc:1428] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:09.199848 23548 tablet_bootstrap.cc:492] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: No bootstrap required, opened a new log
I20260811 07:17:09.199924 23548 ts_tablet_manager.cc:1397] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:09.200126 23548 raft_consensus.cc:348] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.200222 23548 raft_consensus.cc:374] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:09.200254 23548 raft_consensus.cc:729] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b491509bc18149c2b4640e87102690c2, State: Initialized, Role: FOLLOWER
I20260811 07:17:09.200304 23548 consensus_queue.cc:260] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.200416 23548 ts_tablet_manager.cc:1428] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:09.343963 23559 raft_consensus.cc:482] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:17:09.344102 23559 raft_consensus.cc:504] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.344771 23559 leader_election.cc:288] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367), edd3e1428b40465b9fc5b363eda8704c (127.9.142.131:39291)
I20260811 07:17:09.350445 23544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.345357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:59623 (local address 127.9.142.129:41367)
0811 07:17:09.345605 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:09.345608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:09.345628 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:17:09.345897 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:09.345900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:09.345929 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:09.345966 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:09.346191 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.346978 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.349226 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.349992 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.350086 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.350097 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:09.350337 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 07:17:09.350377 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196}
I20260811 07:17:09.350445 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.345555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:50445 (local address 127.9.142.131:39291)
0811 07:17:09.345618 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:09.345620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:09.345631 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:17:09.345740 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:09.345741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:09.345753 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:09.345838 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:09.346051 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.346961 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.349226 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.349997 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.350086 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.350097 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:09.350312 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 07:17:09.350356 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 07:17:09.350560 23679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.345393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:39291 (local address 127.9.142.130:50445)
0811 07:17:09.345545 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:09.345558 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:09.345630 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:09.345859 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:09.345861 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:09.345863 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:09.345956 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:09.345959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.347085 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.347086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:09.349104 (+ 2018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:09.349107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.350116 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.350119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:09.350208 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.350213 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:17:09.350279 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 07:17:09.350333 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":82,"thread_start_us":46,"threads_started":1}
I20260811 07:17:09.350560 23676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.345131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:41367 (local address 127.9.142.130:59623)
0811 07:17:09.345339 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:09.345354 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:09.345620 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:09.346051 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:09.346051 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:09.346053 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:09.346115 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:09.346116 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.347087 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.347088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:09.349108 (+ 2020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:09.349109 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.350124 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.350124 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:09.350208 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.350215 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:17:09.350323 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:17:09.350352 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":107,"thread_start_us":123,"threads_started":1}
I20260811 07:17:09.351014 23424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dca2efb3f4b4a2d8c5d50b08dd232ed" candidate_uuid: "b491509bc18149c2b4640e87102690c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd3e1428b40465b9fc5b363eda8704c" is_pre_election: true
I20260811 07:17:09.351015 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dca2efb3f4b4a2d8c5d50b08dd232ed" candidate_uuid: "b491509bc18149c2b4640e87102690c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16978d942dc24fcca4b730019da99c2c" is_pre_election: true
I20260811 07:17:09.351127 22953 raft_consensus.cc:2454] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b491509bc18149c2b4640e87102690c2 in term 0.
I20260811 07:17:09.351127 23424 raft_consensus.cc:2454] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b491509bc18149c2b4640e87102690c2 in term 0.
I20260811 07:17:09.351328 23085 leader_election.cc:302] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16978d942dc24fcca4b730019da99c2c, b491509bc18149c2b4640e87102690c2; no voters:
I20260811 07:17:09.351495 23559 raft_consensus.cc:2781] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:17:09.351544 23559 raft_consensus.cc:482] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:17:09.351572 23559 raft_consensus.cc:3037] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:09.352387 23559 raft_consensus.cc:504] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.352543 23559 leader_election.cc:288] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [CANDIDATE]: Term 1 election: Requested vote from peers 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367), edd3e1428b40465b9fc5b363eda8704c (127.9.142.131:39291)
I20260811 07:17:09.352766 23424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dca2efb3f4b4a2d8c5d50b08dd232ed" candidate_uuid: "b491509bc18149c2b4640e87102690c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edd3e1428b40465b9fc5b363eda8704c"
I20260811 07:17:09.352769 22953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dca2efb3f4b4a2d8c5d50b08dd232ed" candidate_uuid: "b491509bc18149c2b4640e87102690c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16978d942dc24fcca4b730019da99c2c"
I20260811 07:17:09.352849 23424 raft_consensus.cc:3037] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:09.352873 22953 raft_consensus.cc:3037] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:09.353556 23424 raft_consensus.cc:2454] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b491509bc18149c2b4640e87102690c2 in term 1.
I20260811 07:17:09.353581 22953 raft_consensus.cc:2454] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b491509bc18149c2b4640e87102690c2 in term 1.
I20260811 07:17:09.353740 23085 leader_election.cc:302] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16978d942dc24fcca4b730019da99c2c, b491509bc18149c2b4640e87102690c2; no voters:
I20260811 07:17:09.353859 23559 raft_consensus.cc:2781] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:09.353973 23559 raft_consensus.cc:686] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 1 LEADER]: Becoming Leader. State: Replica: b491509bc18149c2b4640e87102690c2, State: Running, Role: LEADER
I20260811 07:17:09.354056 23559 consensus_queue.cc:237] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } }
I20260811 07:17:09.355000 22696 catalog_manager.cc:5495] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b491509bc18149c2b4640e87102690c2 (127.9.142.130). New cstate: current_term: 1 leader_uuid: "b491509bc18149c2b4640e87102690c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b491509bc18149c2b4640e87102690c2" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 } health_report { overall_health: UNKNOWN } } }
I20260811 07:17:09.388566 23687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.386019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36786 (local address 127.9.142.130:36833)
0811 07:17:09.386168 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:09.386169 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:09.386177 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:09.386216 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:09.386216 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:09.386237 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:09.386310 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:09.386425 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.387079 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.387838 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.388039 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.388096 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.388217 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:09.388325 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:09.388401 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:09.388418 (+ 17us) server_negotiation.cc:299] Negotiation successful
0811 07:17:09.388435 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":98,"threads_started":1}
I20260811 07:17:09.393643 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.390989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:39291 (local address 127.9.142.130:60927)
0811 07:17:09.391215 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:09.391228 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:09.391281 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:09.391495 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:09.391496 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:09.391498 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:17:09.391549 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:09.391550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.392200 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.392200 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:09.392777 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:09.392779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.393180 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.393181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:09.393238 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.393254 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:17:09.393476 (+ 222us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:17:09.393479 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:17:09.393512 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 07:17:09.393559 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":92,"threads_started":1}
I20260811 07:17:09.393754 23541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.391206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:60927 (local address 127.9.142.131:39291)
0811 07:17:09.391264 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:09.391266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:09.391274 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:09.391343 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:09.391343 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:09.391352 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:09.391494 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:09.391602 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.392126 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.392864 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.393105 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.393162 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.393340 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:09.393368 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:09.393604 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:09.393626 (+ 22us) server_negotiation.cc:299] Negotiation successful
0811 07:17:09.393649 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:17:09.396229 22953 raft_consensus.cc:1261] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Refusing update from remote peer b491509bc18149c2b4640e87102690c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:09.396235 23424 raft_consensus.cc:1261] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Refusing update from remote peer b491509bc18149c2b4640e87102690c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:09.396564 23682 consensus_queue.cc:1035] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16978d942dc24fcca4b730019da99c2c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 41367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:09.396739 23559 consensus_queue.cc:1035] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edd3e1428b40465b9fc5b363eda8704c" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:09.404443 23687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.401910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:35257 (local address 127.9.142.130:36833)
0811 07:17:09.401984 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:09.401986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:09.402053 (+ 67us) server_negotiation.cc:407] Connection header received
0811 07:17:09.402127 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:09.402127 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:09.402136 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:09.402188 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:09.402363 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.402908 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.403717 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.404050 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.404126 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.404277 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:09.404304 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:09.404340 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:09.404373 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 07:17:09.404391 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:17:09.404469 23697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.401850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:36833 (local address 127.9.142.131:35257)
0811 07:17:09.401999 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:09.402009 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:09.402069 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:09.402201 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:09.402202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:09.402204 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:17:09.402294 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:09.402295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.402995 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.402997 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:09.403610 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:09.403613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:09.404137 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:09.404138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:09.404204 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:09.404209 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:17:09.404341 (+ 132us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:17:09.404342 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 07:17:09.404371 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 07:17:09.404407 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260811 07:17:09.414003 22691 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:09.414121 22691 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:09.414858 22691 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0596d79a46704f1ab6130c5f05c1ab33: Sending DeleteTablet for 3 replicas of tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed
I20260811 07:17:09.415119 23395 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:09 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:43602
I20260811 07:17:09.415102 22925 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:09 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:48150
I20260811 07:17:09.415143 23169 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:09 UTC) from {username='oryx', principal='oryx/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:36782
I20260811 07:17:09.415203 23581 tablet_replica.cc:330] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: stopping tablet replica
I20260811 07:17:09.415203 23579 tablet_replica.cc:330] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c: stopping tablet replica
I20260811 07:17:09.415251 23579 raft_consensus.cc:2229] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:09.415252 23581 raft_consensus.cc:2229] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:09.415287 23581 raft_consensus.cc:2258] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:09.415287 23579 raft_consensus.cc:2258] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P 16978d942dc24fcca4b730019da99c2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:09.415362 23580 tablet_replica.cc:330] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: stopping tablet replica
I20260811 07:17:09.415417 23580 raft_consensus.cc:2229] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:17:09.415498 23580 raft_consensus.cc:2258] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:09.415793 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 22824
I20260811 07:17:09.426303 23580 ts_tablet_manager.cc:1905] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:09.428133 23580 ts_tablet_manager.cc:1918] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:17:09.428210 23580 log.cc:1196] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/3dca2efb3f4b4a2d8c5d50b08dd232ed
I20260811 07:17:09.428431 23580 ts_tablet_manager.cc:1939] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P b491509bc18149c2b4640e87102690c2: Deleting consensus metadata
I20260811 07:17:09.428785 22676 catalog_manager.cc:4841] TS b491509bc18149c2b4640e87102690c2 (127.9.142.130:36833): tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed (table test-table [id=4a5fc441fe6c4ee7bc6637a58c687df9]) successfully deleted
I20260811 07:17:09.432063 23581 ts_tablet_manager.cc:1905] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:09.433373 23581 ts_tablet_manager.cc:1918] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:17:09.433457 23581 log.cc:1196] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/3dca2efb3f4b4a2d8c5d50b08dd232ed
I20260811 07:17:09.433678 23581 ts_tablet_manager.cc:1939] T 3dca2efb3f4b4a2d8c5d50b08dd232ed P edd3e1428b40465b9fc5b363eda8704c: Deleting consensus metadata
I20260811 07:17:09.434041 22677 catalog_manager.cc:4841] TS edd3e1428b40465b9fc5b363eda8704c (127.9.142.131:39291): tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed (table test-table [id=4a5fc441fe6c4ee7bc6637a58c687df9]) successfully deleted
W20260811 07:17:09.435482 22677 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:41367 (error 108)
I20260811 07:17:09.435757 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 23053
I20260811 07:17:09.442539 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:09.435973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:41367 (local address 127.0.0.1:48166)
0811 07:17:09.442413 (+ 6440us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:09.442492 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:41367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6402,"thread_start_us":49,"threads_started":1}
W20260811 07:17:09.442705 22677 catalog_manager.cc:4584] TS 16978d942dc24fcca4b730019da99c2c (127.9.142.129:41367): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3dca2efb3f4b4a2d8c5d50b08dd232ed: Network error: Client connection negotiation failed: client connection to 127.9.142.129:41367: connect: Connection refused (error 111)
I20260811 07:17:09.448648 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 23290
I20260811 07:17:09.462105 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 22652
2026-08-11T07:17:09Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3324 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:17:09 dist-test-slave-7f01 krb5kdc[23704](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:17:09 dist-test-slave-7f01 krb5kdc[23704](info): set up 2 sockets
Aug 11 07:17:09 dist-test-slave-7f01 krb5kdc[23704](info): commencing operation
krb5kdc: starting...
W20260811 07:17:10.769974 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:17:10 dist-test-slave-7f01 krb5kdc[23704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:17:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:17:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:17:10.906865 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:40597
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:37685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:40597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:10.992094 23725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:10.992331 23725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:10.992370 23725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:10.993572 23725 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:10.993636 23725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:10.993662 23725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:10.993693 23725 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:10.993717 23725 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:10.995193 23725 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:37685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:40597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:40597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:10.995463 23725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:10.995684 23725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:11.000468 23733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:11.000481 23731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:11.000525 23736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:11.000708 23725 server_base.cc:1034] running on GCE node
I20260811 07:17:11.000982 23725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:11.001217 23725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:11.002360 23725 hybrid_clock.cc:648] HybridClock initialized: now 1786432631002347 us; error 36 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T07:17:11Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1549 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:17:11 dist-test-slave-7f01 krb5kdc[23747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:17:11 dist-test-slave-7f01 krb5kdc[23747](info): set up 2 sockets
Aug 11 07:17:11 dist-test-slave-7f01 krb5kdc[23747](info): commencing operation
krb5kdc: starting...
W20260811 07:17:12.323069 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:17:12 dist-test-slave-7f01 krb5kdc[23747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:17:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:17:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:17:12.455078 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41211
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:41211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:12.539974 23778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:12.540235 23778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:12.540275 23778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:12.541414 23778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:12.541489 23778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:12.541514 23778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:12.541543 23778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:12.541575 23778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:12.543088 23778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:41211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:12.543365 23778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:12.543593 23778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:12.548408 23787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:12.548409 23786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:12.548671 23791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:12.548827 23778 server_base.cc:1034] running on GCE node
I20260811 07:17:12.549096 23778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:12.549412 23778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:12.550583 23778 hybrid_clock.cc:648] HybridClock initialized: now 1786432632550566 us; error 47 us; skew 500 ppm
Aug 11 07:17:12 dist-test-slave-7f01 krb5kdc[23747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432632, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:12.553184 23778 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:17:12.553604 23778 webserver.cc:460] Webserver started at http://127.9.142.190:44421/ using document root <none> and password file <none>
I20260811 07:17:12.553857 23778 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:12.553931 23778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:12.554083 23778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:12.555136 23778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "edd62eb552964d09abeb2668fec382a5"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "57cd4061ff0800517ae1b6dcdde9a753"
server_key_iv: "2609be2accdd8aaddc72581e0a2b2cc3"
server_key_version: "encryptionkey@0"
I20260811 07:17:12.555505 23778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "edd62eb552964d09abeb2668fec382a5"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "57cd4061ff0800517ae1b6dcdde9a753"
server_key_iv: "2609be2accdd8aaddc72581e0a2b2cc3"
server_key_version: "encryptionkey@0"
I20260811 07:17:12.556933 23778 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:17:12.557706 23801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:12.557936 23778 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:12.558045 23778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "edd62eb552964d09abeb2668fec382a5"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "57cd4061ff0800517ae1b6dcdde9a753"
server_key_iv: "2609be2accdd8aaddc72581e0a2b2cc3"
server_key_version: "encryptionkey@0"
I20260811 07:17:12.558130 23778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:12.574334 23778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:12.576262 23778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:12.576426 23778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:12.580569 23778 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:41211
I20260811 07:17:12.580634 23882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:41211 every 8 connection(s)
I20260811 07:17:12.580982 23778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:17:12.581836 23883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:12.584316 23883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: Bootstrap starting.
I20260811 07:17:12.584920 23883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:12.585249 23883 log.cc:824] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:12.585966 23883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: No bootstrap required, opened a new log
I20260811 07:17:12.587585 23883 raft_consensus.cc:348] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } }
I20260811 07:17:12.587721 23883 raft_consensus.cc:374] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:12.587816 23883 raft_consensus.cc:729] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd62eb552964d09abeb2668fec382a5, State: Initialized, Role: FOLLOWER
I20260811 07:17:12.587968 23883 consensus_queue.cc:260] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } }
I20260811 07:17:12.588034 23883 raft_consensus.cc:388] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:17:12.588080 23883 raft_consensus.cc:482] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:17:12.588130 23883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:12.588639 23883 raft_consensus.cc:504] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } }
I20260811 07:17:12.588730 23883 leader_election.cc:302] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edd62eb552964d09abeb2668fec382a5; no voters:
I20260811 07:17:12.588884 23883 leader_election.cc:288] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:17:12.588991 23886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:12.589174 23886 raft_consensus.cc:686] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 1 LEADER]: Becoming Leader. State: Replica: edd62eb552964d09abeb2668fec382a5, State: Running, Role: LEADER
I20260811 07:17:12.589188 23883 sys_catalog.cc:564] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:12.589305 23886 consensus_queue.cc:237] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } }
I20260811 07:17:12.589732 23889 sys_catalog.cc:455] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader edd62eb552964d09abeb2668fec382a5. Latest consensus state: current_term: 1 leader_uuid: "edd62eb552964d09abeb2668fec382a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } } }
I20260811 07:17:12.589704 23887 sys_catalog.cc:455] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "edd62eb552964d09abeb2668fec382a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } } }
I20260811 07:17:12.589850 23889 sys_catalog.cc:458] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:12.590236 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 23778
I20260811 07:17:12.590380 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:17:12.589968 23887 sys_catalog.cc:458] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:12.590519 23895 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:17:12.590626 9786 external_mini_cluster.cc:1428] Setting key 7de76a4bd5222a7b50cb9cf6f7c38d79
I20260811 07:17:12.591246 23895 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:17:12.592960 23895 catalog_manager.cc:1347] Generated new cluster ID: 592cb9fc222644349a02067629525e3a
I20260811 07:17:12.593020 23895 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:17:12 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:12.601255 23916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:12.591161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38616 (local address 127.9.142.190:41211)
0811 07:17:12.591482 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:12.591491 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:12.591521 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:17:12.591640 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:12.591646 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:12.591718 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:12.591916 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:12.592770 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.593744 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.594514 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.594979 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.595103 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:12.597440 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:12.597444 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:12.597444 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:12.597456 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:12.599603 (+ 2147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:12.600033 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:12.600036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:12.600036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:12.600164 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:12.600397 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:12.600398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:12.600398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:12.600625 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:12.600801 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:12.600900 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 07:17:12.601044 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":80,"threads_started":1}
I20260811 07:17:12.620608 23895 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:17:12.621328 23895 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:17:12.624042 23895 catalog_manager.cc:5868] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: Generated new TSK 0
I20260811 07:17:12.624236 23895 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:17:12.654876 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41211
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:12.739513 23924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:12.739827 23924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:12.739898 23924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:12.741066 23924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:12.741138 23924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:12.741184 23924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:17:12.742619 23924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41211
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:12.742898 23924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:12.743165 23924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:12.748085 23933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:12.748068 23935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:12.748152 23924 server_base.cc:1034] running on GCE node
W20260811 07:17:12.748068 23931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:12.748518 23924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:12.748783 23924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:12.749953 23924 hybrid_clock.cc:648] HybridClock initialized: now 1786432632749945 us; error 37 us; skew 500 ppm
Aug 11 07:17:12 dist-test-slave-7f01 krb5kdc[23747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432632, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:12.752903 23924 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:17:12.753345 23924 webserver.cc:460] Webserver started at http://127.9.142.129:46735/ using document root <none> and password file <none>
I20260811 07:17:12.753572 23924 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:12.753640 23924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:12.753783 23924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:12.754853 23924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "af39203ab1d74f7583d52ca4eae08a0d"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "bd271edc99b5bc032131982f972265af"
server_key_iv: "787f12c4dcbe6737e71ec7389a5b4347"
server_key_version: "encryptionkey@0"
I20260811 07:17:12.755223 23924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "af39203ab1d74f7583d52ca4eae08a0d"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "bd271edc99b5bc032131982f972265af"
server_key_iv: "787f12c4dcbe6737e71ec7389a5b4347"
server_key_version: "encryptionkey@0"
I20260811 07:17:12.756688 23924 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:17:12.757493 23946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:12.757669 23924 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:12.757777 23924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "af39203ab1d74f7583d52ca4eae08a0d"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "bd271edc99b5bc032131982f972265af"
server_key_iv: "787f12c4dcbe6737e71ec7389a5b4347"
server_key_version: "encryptionkey@0"
I20260811 07:17:12.757853 23924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:12.768565 23924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:12.770633 23924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:12.770790 23924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:12.771021 23924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:12.771333 23924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:12.771390 23924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:12.771426 23924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:12.771453 23924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:12.778364 23924 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:36751
I20260811 07:17:12.778414 24119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:36751 every 8 connection(s)
I20260811 07:17:12.778733 23924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:17:12.780668 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 23924
I20260811 07:17:12.780820 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:17:12.781054 9786 external_mini_cluster.cc:1428] Setting key 970d34f6b39f96290b1bb205bd084f85
Aug 11 07:17:12 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432632, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:12.789271 23916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:12.779438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:45745 (local address 127.9.142.190:41211)
0811 07:17:12.779482 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:12.779484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:12.779701 (+ 217us) server_negotiation.cc:407] Connection header received
0811 07:17:12.780277 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:12.780278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:12.780292 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:12.780362 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:12.781576 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.782190 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.783728 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.784025 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.784062 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:12.786275 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:12.786277 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:12.786277 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:12.786285 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:12.787781 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:12.788218 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:12.788219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:12.788220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:12.788289 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:12.788544 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:12.788545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:12.788545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:12.788683 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:12.788758 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:12.789073 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 07:17:12.789177 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:17:12.789433 24123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:12.779388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:45745)
0811 07:17:12.779571 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:12.779615 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:12.780184 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:12.780415 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:12.780419 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:12.781272 (+ 853us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:12.781483 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:12.781488 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.782294 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.782295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:12.783604 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:12.783608 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.784141 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.784142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:12.784241 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:12.784777 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:12.784786 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:12.786183 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:12.787901 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:12.787909 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:12.787911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:12.788137 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:12.788357 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:12.788358 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:12.788359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:12.788472 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:12.788762 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:12.788769 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:12.788925 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 07:17:12.789030 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:17:12.789191 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":114,"threads_started":1}
I20260811 07:17:12.789968 24120 heartbeater.cc:347] Connected to a master server at 127.9.142.190:41211
I20260811 07:17:12.790093 24120 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:12.790297 24120 heartbeater.cc:511] Master 127.9.142.190:41211 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
I20260811 07:17:12.790915 23828 ts_manager.cc:194] Registered new tserver with Master: af39203ab1d74f7583d52ca4eae08a0d (127.9.142.129:36751)
I20260811 07:17:12.791565 23828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:45745
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:17:12.810072 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41211
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:12.895985 24126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:12.896220 24126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:12.896257 24126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:12.897418 24126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:12.897481 24126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:12.897528 24126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:17:12.899019 24126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41211
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:12.899291 24126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:12.899529 24126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:12.905539 24143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:12.905542 24142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:12.905737 24147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:12.905826 24126 server_base.cc:1034] running on GCE node
I20260811 07:17:12.906070 24126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:12.906296 24126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:12.907526 24126 hybrid_clock.cc:648] HybridClock initialized: now 1786432632907511 us; error 30 us; skew 500 ppm
Aug 11 07:17:12 dist-test-slave-7f01 krb5kdc[23747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432632, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:12.910424 24126 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:17:12.910880 24126 webserver.cc:460] Webserver started at http://127.9.142.130:34049/ using document root <none> and password file <none>
I20260811 07:17:12.911115 24126 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:12.911162 24126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:12.911262 24126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:12.912520 24126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "6a31425792654865a11f67faa829f27d"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "2bb889a20c4c83b973247a0499f5f121"
server_key_iv: "f52e1a79a9dcb60ce49704dca777aaa7"
server_key_version: "encryptionkey@0"
I20260811 07:17:12.912876 24126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "6a31425792654865a11f67faa829f27d"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "2bb889a20c4c83b973247a0499f5f121"
server_key_iv: "f52e1a79a9dcb60ce49704dca777aaa7"
server_key_version: "encryptionkey@0"
I20260811 07:17:12.914316 24126 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:17:12.915129 24156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:12.915375 24126 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:12.915496 24126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "6a31425792654865a11f67faa829f27d"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "2bb889a20c4c83b973247a0499f5f121"
server_key_iv: "f52e1a79a9dcb60ce49704dca777aaa7"
server_key_version: "encryptionkey@0"
I20260811 07:17:12.915580 24126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:12.933022 24126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:12.935180 24126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:12.935333 24126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:12.935588 24126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:12.935987 24126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:12.936046 24126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:12.936082 24126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:12.936110 24126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:12.942091 24126 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:46191
I20260811 07:17:12.942178 24347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:46191 every 8 connection(s)
I20260811 07:17:12.942507 24126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:17:12.945761 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 24126
I20260811 07:17:12.945866 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:17:12.946097 9786 external_mini_cluster.cc:1428] Setting key 0192a3882666a993590e502eb3dfdb0b
Aug 11 07:17:12 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432632, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:12.954013 23916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:12.943306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:44067 (local address 127.9.142.190:41211)
0811 07:17:12.943631 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:12.943633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:12.943717 (+ 84us) server_negotiation.cc:407] Connection header received
0811 07:17:12.944311 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:12.944313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:12.944326 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:12.944401 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:12.945560 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.946300 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.947837 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.948041 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.948103 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:12.950794 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:12.950796 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:12.950796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:12.950806 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:12.952395 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:12.952877 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:12.952878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:12.952879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:12.952944 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:12.953235 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:12.953236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:12.953236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:12.953367 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:12.953447 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:12.953816 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 07:17:12.953911 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263}
I20260811 07:17:12.954267 24352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:12.943272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:44067)
0811 07:17:12.943572 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:12.943616 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:12.944163 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:12.944465 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:12.944468 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:12.945244 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:12.945452 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:12.945457 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.946433 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.946434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:12.947662 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:12.947666 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:12.948131 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:12.948133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:12.948277 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:12.948949 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:12.948960 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:12.950684 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:12.952506 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:12.952514 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:12.952517 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:12.952766 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:12.953025 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:12.953026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:12.953026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:12.953150 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:12.953451 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:12.953460 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:12.953649 (+ 189us) client_negotiation.cc:769] Sending connection context
0811 07:17:12.953777 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 07:17:12.953961 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":222,"threads_started":1}
I20260811 07:17:12.954753 24348 heartbeater.cc:347] Connected to a master server at 127.9.142.190:41211
I20260811 07:17:12.954870 24348 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:12.955070 24348 heartbeater.cc:511] Master 127.9.142.190:41211 requested a full tablet report, sending...
I20260811 07:17:12.955506 23828 ts_manager.cc:194] Registered new tserver with Master: 6a31425792654865a11f67faa829f27d (127.9.142.130:46191)
I20260811 07:17:12.956073 23828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:44067
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:17:12.975927 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41211
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:13.064419 24358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:13.064667 24358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:13.064705 24358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:13.065876 24358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:13.065945 24358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:13.065994 24358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:17:13.067467 24358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41211
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:13.067788 24358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:13.068042 24358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:13.073320 24369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:13.073336 24367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:13.073369 24372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:13.073699 24358 server_base.cc:1034] running on GCE node
I20260811 07:17:13.073951 24358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:13.074196 24358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:13.075376 24358 hybrid_clock.cc:648] HybridClock initialized: now 1786432633075347 us; error 46 us; skew 500 ppm
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432633, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:13.078159 24358 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:17:13.078791 24358 webserver.cc:460] Webserver started at http://127.9.142.131:34323/ using document root <none> and password file <none>
I20260811 07:17:13.079047 24358 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:13.079123 24358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:13.079288 24358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:13.080515 24358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "5c9d7d563a974f34b3355543a1927a70"
format_stamp: "Formatted at 2026-08-11 07:17:13 on dist-test-slave-7f01"
server_key: "81dd936265036e03a82cf42757589701"
server_key_iv: "8a79a92fca2b47528fd2fa21e4b9f98f"
server_key_version: "encryptionkey@0"
I20260811 07:17:13.080909 24358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "5c9d7d563a974f34b3355543a1927a70"
format_stamp: "Formatted at 2026-08-11 07:17:13 on dist-test-slave-7f01"
server_key: "81dd936265036e03a82cf42757589701"
server_key_iv: "8a79a92fca2b47528fd2fa21e4b9f98f"
server_key_version: "encryptionkey@0"
I20260811 07:17:13.082392 24358 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:17:13.083227 24381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.083434 24358 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:13.083552 24358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "5c9d7d563a974f34b3355543a1927a70"
format_stamp: "Formatted at 2026-08-11 07:17:13 on dist-test-slave-7f01"
server_key: "81dd936265036e03a82cf42757589701"
server_key_iv: "8a79a92fca2b47528fd2fa21e4b9f98f"
server_key_version: "encryptionkey@0"
I20260811 07:17:13.083632 24358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:13.091718 24358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:13.094213 24358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:13.094412 24358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:13.094673 24358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:13.095101 24358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:13.095181 24358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.095229 24358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:13.095258 24358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.102329 24358 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:33561
I20260811 07:17:13.102380 24559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:33561 every 8 connection(s)
I20260811 07:17:13.102751 24358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432633, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:13.112218 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 24358
I20260811 07:17:13.112346 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:17:13.112546 9786 external_mini_cluster.cc:1428] Setting key abf7b9484f2944298206de0d7d72bd2b
I20260811 07:17:13.114017 23916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.104007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:51397 (local address 127.9.142.190:41211)
0811 07:17:13.104079 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.104081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.104294 (+ 213us) server_negotiation.cc:407] Connection header received
0811 07:17:13.104969 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.104970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.104982 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.105050 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.106174 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.106735 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.107846 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.108084 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.108153 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.110439 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:13.110440 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:13.110440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:13.110449 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:13.112295 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:13.112954 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:13.112955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:13.112956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:13.113055 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:13.113345 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:13.113346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:13.113346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:13.113488 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:13.113558 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:13.113867 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 07:17:13.113937 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:17:13.114176 24564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.103987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:51397)
0811 07:17:13.104159 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.104204 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.104836 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.105193 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.105197 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.105845 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.106053 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.106058 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.106870 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.106871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.107695 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.107697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.108171 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.108172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.108279 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.108882 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.108891 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.110313 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:13.112472 (+ 2159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:13.112489 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:13.112491 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:13.112864 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:13.113116 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:13.113117 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:13.113117 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:13.113267 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:13.113546 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:13.113553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:13.113727 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 07:17:13.113822 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:17:13.113959 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260811 07:17:13.114706 24560 heartbeater.cc:347] Connected to a master server at 127.9.142.190:41211
I20260811 07:17:13.114836 24560 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:13.115036 24560 heartbeater.cc:511] Master 127.9.142.190:41211 requested a full tablet report, sending...
I20260811 07:17:13.115563 23828 ts_manager.cc:194] Registered new tserver with Master: 5c9d7d563a974f34b3355543a1927a70 (127.9.142.131:33561)
I20260811 07:17:13.115993 23828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:51397
I20260811 07:17:13.124684 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab.
Entry for principal oryx/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab.
WARNING: no policy specified for oryx/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab.
Entry for principal oryx/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab.
WARNING: no policy specified for oryx/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab.
Entry for principal oryx/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab.
I20260811 07:17:13.208554 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 23924
I20260811 07:17:13.221905 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 24126
I20260811 07:17:13.228551 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 24358
I20260811 07:17:13.237322 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 23778
I20260811 07:17:13.254180 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41211
--webserver_interface=127.9.142.190
--webserver_port=44421
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:41211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:13.341593 24578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:13.341797 24578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:13.341820 24578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:13.342969 24578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:13.343012 24578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:13.343027 24578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:13.343039 24578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:13.343089 24578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:13.344559 24578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:41211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=44421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:13.344825 24578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:13.345068 24578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:13.349970 24589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:13.350045 24587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:13.350194 24578 server_base.cc:1034] running on GCE node
W20260811 07:17:13.350003 24586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:13.350564 24578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:13.350862 24578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:13.352033 24578 hybrid_clock.cc:648] HybridClock initialized: now 1786432633352018 us; error 26 us; skew 500 ppm
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432633, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:13.354465 24578 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:17:13.354946 24578 webserver.cc:460] Webserver started at http://127.9.142.190:44421/ using document root <none> and password file <none>
I20260811 07:17:13.355189 24578 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:13.355275 24578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:13.356684 24578 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:13.357386 24608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.357560 24578 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:13.357673 24578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "edd62eb552964d09abeb2668fec382a5"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "57cd4061ff0800517ae1b6dcdde9a753"
server_key_iv: "2609be2accdd8aaddc72581e0a2b2cc3"
server_key_version: "encryptionkey@0"
I20260811 07:17:13.358065 24578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:13.371763 24578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:13.373545 24578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:13.373711 24578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:13.378012 24578 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:41211
I20260811 07:17:13.378048 24686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:41211 every 8 connection(s)
I20260811 07:17:13.378437 24578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:17:13.379954 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 24578
I20260811 07:17:13.379971 24687 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:17:13.380288 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:36751
--local_ip_for_outbound_sockets=127.9.142.129
--tserver_master_addrs=127.9.142.190:41211
--webserver_port=46735
--webserver_interface=127.9.142.129
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.142.129
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:17:13.380750 24687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: Bootstrap starting.
I20260811 07:17:13.390090 24687 log.cc:824] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:13.391996 24687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:17:13.392289 24687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: Bootstrap complete.
I20260811 07:17:13.394610 24687 raft_consensus.cc:348] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } }
I20260811 07:17:13.394837 24687 raft_consensus.cc:729] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: edd62eb552964d09abeb2668fec382a5, State: Initialized, Role: FOLLOWER
I20260811 07:17:13.395025 24687 consensus_queue.cc:260] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } }
I20260811 07:17:13.395087 24687 raft_consensus.cc:388] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:17:13.395152 24687 raft_consensus.cc:482] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:17:13.395200 24687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:17:13.396277 24687 raft_consensus.cc:504] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } }
I20260811 07:17:13.396369 24687 leader_election.cc:302] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edd62eb552964d09abeb2668fec382a5; no voters:
I20260811 07:17:13.396602 24687 leader_election.cc:288] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:17:13.396638 24691 raft_consensus.cc:2781] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:17:13.396757 24691 raft_consensus.cc:686] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [term 2 LEADER]: Becoming Leader. State: Replica: edd62eb552964d09abeb2668fec382a5, State: Running, Role: LEADER
I20260811 07:17:13.396845 24691 consensus_queue.cc:237] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } }
I20260811 07:17:13.396893 24687 sys_catalog.cc:564] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:13.397133 24691 sys_catalog.cc:455] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "edd62eb552964d09abeb2668fec382a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } } }
I20260811 07:17:13.397205 24691 sys_catalog.cc:458] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:13.397346 24691 sys_catalog.cc:455] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader edd62eb552964d09abeb2668fec382a5. Latest consensus state: current_term: 2 leader_uuid: "edd62eb552964d09abeb2668fec382a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edd62eb552964d09abeb2668fec382a5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41211 } } }
I20260811 07:17:13.397418 24691 sys_catalog.cc:458] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:13.397715 24697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:17:13.398222 24697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:17:13.398401 24697 catalog_manager.cc:1259] Loaded cluster ID: 592cb9fc222644349a02067629525e3a
I20260811 07:17:13.398530 24697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:17:13.399433 24697 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:17:13.399641 24697 catalog_manager.cc:5879] T 00000000000000000000000000000000 P edd62eb552964d09abeb2668fec382a5: Loaded TSK: 0
I20260811 07:17:13.399893 24697 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:17:13.488374 24689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:13.488612 24689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:13.488651 24689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:13.489813 24689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:13.489880 24689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:13.489925 24689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:17:13.491406 24689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.129.keytab
--principal=oryx/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:36751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=46735
--tserver_master_addrs=127.9.142.190:41211
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:13.491684 24689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:13.491951 24689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:13.497973 24738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:13.498095 24731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:13.497973 24736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:13.498327 24689 server_base.cc:1034] running on GCE node
I20260811 07:17:13.498579 24689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:13.498860 24689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:13.500021 24689 hybrid_clock.cc:648] HybridClock initialized: now 1786432633500008 us; error 27 us; skew 500 ppm
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432633, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:13.502843 24689 init.cc:377] Logged in from keytab as oryx/127.9.142.129@KRBTEST.COM (short username oryx)
I20260811 07:17:13.503293 24689 webserver.cc:460] Webserver started at http://127.9.142.129:46735/ using document root <none> and password file <none>
I20260811 07:17:13.503561 24689 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:13.503655 24689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:13.505158 24689 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:13.505869 24749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.506086 24689 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:13.506204 24689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "af39203ab1d74f7583d52ca4eae08a0d"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "bd271edc99b5bc032131982f972265af"
server_key_iv: "787f12c4dcbe6737e71ec7389a5b4347"
server_key_version: "encryptionkey@0"
I20260811 07:17:13.506590 24689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:13.537746 24689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:13.540053 24689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:13.540230 24689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:13.540485 24689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:13.540810 24689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:13.540869 24689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.540917 24689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:13.540958 24689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.547684 24689 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:36751
I20260811 07:17:13.547839 24949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:36751 every 8 connection(s)
I20260811 07:17:13.548147 24689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:13.558045 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 24689
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:13.558384 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:46191
--local_ip_for_outbound_sockets=127.9.142.130
--tserver_master_addrs=127.9.142.190:41211
--webserver_port=34049
--webserver_interface=127.9.142.130
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.142.130
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:17:13.559278 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.548864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:35445)
0811 07:17:13.549094 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.549145 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.549758 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.552247 (+ 2489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.552252 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.553021 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.553306 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.553313 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.554363 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.554364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.555197 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.555200 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.555873 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.555874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.555974 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.556529 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.556537 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.559063 (+ 2526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":104,"threads_started":1}
W20260811 07:17:13.559342 24955 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:13.548990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:35445 (local address 127.9.142.190:41211)
0811 07:17:13.551865 (+ 2875us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.551872 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.551900 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:17:13.552010 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.552015 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.552054 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.552159 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.553425 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.554264 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.555300 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.555706 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.555845 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.559182 (+ 3337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:35445: BlockingRecv error: recv got EOF from 127.9.142.129:35445 (error 108)
Metrics: {"server-negotiator.queue_time_us":2822,"thread_start_us":80,"threads_started":1}
W20260811 07:17:13.559540 24950 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:41211 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.142.190:41211: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:13.564819 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.559779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:34801)
0811 07:17:13.559918 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.559928 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.559979 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.560125 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.560126 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.560298 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.560355 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.560357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.561122 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.561123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.561859 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.561862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.562371 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.562372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.562418 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.562885 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.562889 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.564771 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
W20260811 07:17:13.564985 24955 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:13.559833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:34801 (local address 127.9.142.190:41211)
0811 07:17:13.559874 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.559877 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.559969 (+ 92us) server_negotiation.cc:407] Connection header received
0811 07:17:13.560022 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.560023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.560036 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.560103 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.560490 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.561044 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.561947 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.562283 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.562359 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.564900 (+ 2541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:34801: BlockingRecv error: recv got EOF from 127.9.142.129:34801 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:13.570138 24956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.565065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:35145)
0811 07:17:13.565159 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.565173 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.565230 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.565387 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.565388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.565597 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.565665 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.565667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.566255 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.566256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.567279 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.567283 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.567640 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.567642 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.567724 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.568142 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.568148 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.570038 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 07:17:13.570168 24955 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:13.565181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:35145 (local address 127.9.142.190:41211)
0811 07:17:13.565220 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.565222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.565231 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:13.565305 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.565305 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.565313 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.565361 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.565744 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.566174 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.567373 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.567546 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.567590 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.570104 (+ 2514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:35145: BlockingRecv error: recv got EOF from 127.9.142.129:35145 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 07:17:13.570271 24950 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:17:13.645954 24958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:13.646205 24958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:13.646243 24958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:13.647415 24958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:13.647488 24958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:13.647533 24958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:17:13.649052 24958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.130.keytab
--principal=oryx/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:46191
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=34049
--tserver_master_addrs=127.9.142.190:41211
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:13.649329 24958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:13.649573 24958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:13.654565 24972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:13.654606 24969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:13.654583 24968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:13.655179 24958 server_base.cc:1034] running on GCE node
I20260811 07:17:13.655441 24958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:13.655718 24958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:13.656930 24958 hybrid_clock.cc:648] HybridClock initialized: now 1786432633656903 us; error 41 us; skew 500 ppm
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432633, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:13.659497 24958 init.cc:377] Logged in from keytab as oryx/127.9.142.130@KRBTEST.COM (short username oryx)
I20260811 07:17:13.660020 24958 webserver.cc:460] Webserver started at http://127.9.142.130:34049/ using document root <none> and password file <none>
I20260811 07:17:13.660286 24958 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:13.660408 24958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:13.661826 24958 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 07:17:13.662456 24985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.662640 24958 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:13.662756 24958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "6a31425792654865a11f67faa829f27d"
format_stamp: "Formatted at 2026-08-11 07:17:12 on dist-test-slave-7f01"
server_key: "2bb889a20c4c83b973247a0499f5f121"
server_key_iv: "f52e1a79a9dcb60ce49704dca777aaa7"
server_key_version: "encryptionkey@0"
I20260811 07:17:13.663117 24958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:13.672416 24958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:13.674233 24958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:13.674495 24958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:13.674790 24958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:13.675123 24958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:13.675184 24958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.675228 24958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:13.675256 24958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.681669 24958 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:46191
I20260811 07:17:13.681716 25193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:46191 every 8 connection(s)
I20260811 07:17:13.682083 24958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:17:13.685371 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 24958
I20260811 07:17:13.685747 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:33561
--local_ip_for_outbound_sockets=127.9.142.131
--tserver_master_addrs=127.9.142.190:41211
--webserver_port=34323
--webserver_interface=127.9.142.131
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.142.131
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:17:13.690650 24955 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:13.682877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:48709 (local address 127.9.142.190:41211)
0811 07:17:13.682926 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.682933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.683191 (+ 258us) server_negotiation.cc:407] Connection header received
0811 07:17:13.683787 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.683788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.683808 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.683862 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.684984 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.685840 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.686991 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.687199 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.687280 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.690591 (+ 3311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:48709: BlockingRecv error: recv got EOF from 127.9.142.130:48709 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:17:13.690717 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.682853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:48709)
0811 07:17:13.683053 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.683092 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.683637 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.683933 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.683937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.684545 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.684852 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.684859 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.685986 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.685987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.686886 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.686889 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.687290 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.687292 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.687426 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.688059 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.688067 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.690510 (+ 2443us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":82,"threads_started":1}
W20260811 07:17:13.690958 25195 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:41211 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.142.190:41211: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:13.695370 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.691176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:41349)
0811 07:17:13.691228 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.691238 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.691297 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.691459 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.691460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.691591 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.691645 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.691647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.692322 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.692323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.692812 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.692814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.693169 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.693170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.693242 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.693686 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.693693 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.695325 (+ 1632us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 07:17:13.695556 24955 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:13.691248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:41349 (local address 127.9.142.190:41211)
0811 07:17:13.691326 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.691328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.691337 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:13.691363 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.691364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.691374 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.691454 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.691726 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.692220 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.692900 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.693095 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.693170 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.695469 (+ 2299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:41349: BlockingRecv error: recv got EOF from 127.9.142.130:41349 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:13.701285 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.695892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:41139)
0811 07:17:13.696047 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.696060 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.696125 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.696302 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.696304 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.696484 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.696525 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.696527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.697432 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.697433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.698448 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.698452 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.698885 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.698886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.698962 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.699396 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.699402 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.701203 (+ 1801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133}
W20260811 07:17:13.701341 24955 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:13.695970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:41139 (local address 127.9.142.190:41211)
0811 07:17:13.696050 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.696052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.696138 (+ 86us) server_negotiation.cc:407] Connection header received
0811 07:17:13.696187 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.696187 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.696196 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.696274 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.696614 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.697347 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.698556 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.698800 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.698869 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.701276 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:41139: BlockingRecv error: recv got EOF from 127.9.142.130:41139 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 07:17:13.701457 25195 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:17:13.777129 25199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:13.777354 25199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:13.777379 25199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:13.778542 25199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:13.778585 25199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:13.778612 25199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:17:13.780061 25199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/krb5kdc/oryx_127.9.142.131.keytab
--principal=oryx/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:33561
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=34323
--tserver_master_addrs=127.9.142.190:41211
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:13.780315 25199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:13.780560 25199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:13.785601 25209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:13.785668 25208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:13.785614 25213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:13.785833 25199 server_base.cc:1034] running on GCE node
I20260811 07:17:13.786062 25199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:13.786280 25199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:13.787447 25199 hybrid_clock.cc:648] HybridClock initialized: now 1786432633787434 us; error 33 us; skew 500 ppm
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432633, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:13.796947 25199 init.cc:377] Logged in from keytab as oryx/127.9.142.131@KRBTEST.COM (short username oryx)
I20260811 07:17:13.797513 25199 webserver.cc:460] Webserver started at http://127.9.142.131:34323/ using document root <none> and password file <none>
I20260811 07:17:13.797727 25199 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:13.797786 25199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:13.799371 25199 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:17:13.800133 25226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.800467 25199 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:13.800557 25199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "5c9d7d563a974f34b3355543a1927a70"
format_stamp: "Formatted at 2026-08-11 07:17:13 on dist-test-slave-7f01"
server_key: "81dd936265036e03a82cf42757589701"
server_key_iv: "8a79a92fca2b47528fd2fa21e4b9f98f"
server_key_version: "encryptionkey@0"
I20260811 07:17:13.800958 25199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:13.820516 25199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:13.822990 25199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:13.823108 25199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:13.823287 25199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:13.823616 25199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:13.823650 25199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.823696 25199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:13.823724 25199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:13.829869 25199 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:33561
I20260811 07:17:13.829983 25426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:33561 every 8 connection(s)
I20260811 07:17:13.830338 25199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:17:13.832882 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 25199
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:17:13.839373 24955 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:13.831151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:44469 (local address 127.9.142.190:41211)
0811 07:17:13.831221 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.831224 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.831545 (+ 321us) server_negotiation.cc:407] Connection header received
0811 07:17:13.832117 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.832119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.832129 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.832182 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.833221 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.834049 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.835329 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.835553 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.835604 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.839303 (+ 3699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:44469: BlockingRecv error: recv got EOF from 127.9.142.131:44469 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 07:17:13.839465 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.831150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:44469)
0811 07:17:13.831398 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.831440 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.832024 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.832246 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.832250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.832852 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.833099 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.833106 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.834152 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.834154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.835238 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.835241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.835638 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.835640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.835813 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.836505 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.836514 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.839238 (+ 2724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":97,"threads_started":1}
W20260811 07:17:13.839725 25427 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:41211 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.142.190:41211: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
I20260811 07:17:13.841735 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.833642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38624 (local address 127.9.142.190:41211)
0811 07:17:13.833817 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.833819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.833827 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:13.833852 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.833853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.833864 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.833940 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.834792 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.835265 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.836265 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.836486 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.836589 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.838025 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:13.838030 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:13.838031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:13.838043 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:13.840237 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:13.840597 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:13.840600 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:13.840601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:13.840722 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:13.840950 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:13.840951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:13.840951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:13.841200 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:13.841365 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:13.841492 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 07:17:13.841607 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":83,"threads_started":1}
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:13.844677 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.840027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:42189)
0811 07:17:13.840077 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.840087 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.840125 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.840274 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.840276 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.840420 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.840468 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.840469 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.841127 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.841128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.841678 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.841680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.842118 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.842119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.842194 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.842648 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.842654 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.844630 (+ 1976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 07:17:13.844897 24955 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:13.840082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:42189 (local address 127.9.142.190:41211)
0811 07:17:13.840118 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.840120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.840129 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:13.840179 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.840179 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.840186 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.840235 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.840550 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.841040 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.841759 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.842055 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.842113 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.844842 (+ 2729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:42189: BlockingRecv error: recv got EOF from 127.9.142.131:42189 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:13 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:13.849505 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:13.845161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:35495)
0811 07:17:13.845216 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:13.845228 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:13.845278 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:13.845573 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:13.845574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:13.845700 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:13.845731 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.845732 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.846394 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.846395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.846892 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:13.846893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.847224 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.847224 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:13.847262 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.847711 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:13.847715 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:13.849453 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 07:17:13.849659 24955 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:13.845223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:35495 (local address 127.9.142.190:41211)
0811 07:17:13.845268 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:13.845269 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:13.845276 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:17:13.845340 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:13.845341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:13.845348 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:13.845403 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:13.845830 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.846288 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.846982 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:13.847154 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:13.847213 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:13.849583 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:35495: BlockingRecv error: recv got EOF from 127.9.142.131:35495 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 07:17:13.849675 25427 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 07:17:14 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:14 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:14.575600 25437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:14.570657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:33171)
0811 07:17:14.570826 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:14.570841 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:14.570894 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:14.571030 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:14.571031 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:14.571201 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:14.571253 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:14.571255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.572019 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.572020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:14.572693 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:14.572696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.573034 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.573034 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:14.573075 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:14.573626 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:14.573631 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:14.575540 (+ 1909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
W20260811 07:17:14.575766 25439 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:14.570764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:33171 (local address 127.9.142.190:41211)
0811 07:17:14.570915 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:14.570916 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:14.570924 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:14.570946 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:14.570946 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:14.570955 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:14.571012 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:14.571319 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.571935 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.572762 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.572967 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.573022 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:14.575652 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:33171: BlockingRecv error: recv got EOF from 127.9.142.129:33171 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":88,"threads_started":1}
Aug 11 07:17:14 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:14 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:14.706849 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:14.701871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:33261)
0811 07:17:14.702038 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:14.702055 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:14.702134 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:14.702333 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:14.702334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:14.702530 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:14.702584 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:14.702586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.703281 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.703282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:14.703915 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:14.703918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.704300 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.704302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:14.704369 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:14.704870 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:14.704876 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:14.706720 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":76,"threads_started":1}
W20260811 07:17:14.706887 25439 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:14.701926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:33261 (local address 127.9.142.190:41211)
0811 07:17:14.702002 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:14.702004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:14.702117 (+ 113us) server_negotiation.cc:407] Connection header received
0811 07:17:14.702239 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:14.702240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:14.702252 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:14.702317 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:14.702666 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.703188 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.703998 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.704238 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.704302 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:14.706811 (+ 2509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:33261: BlockingRecv error: recv got EOF from 127.9.142.130:33261 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 07:17:14 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:14 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:14.854846 25441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:14.850073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:57037)
0811 07:17:14.850245 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:14.850258 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:14.850319 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:14.850494 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:14.850495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:14.850674 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:14.850729 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:14.850730 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.851376 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.851376 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:14.852004 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:14.852007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.852340 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.852341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:14.852387 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:14.852900 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:14.852906 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:14.854775 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":90,"threads_started":1}
W20260811 07:17:14.854908 25439 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:14.850291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:57037 (local address 127.9.142.190:41211)
0811 07:17:14.850370 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:14.850372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:14.850380 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:14.850403 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:14.850404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:14.850416 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:14.850471 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:14.850795 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.851310 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.852086 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:14.852270 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:14.852324 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:14.854858 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:57037: BlockingRecv error: recv got EOF from 127.9.142.131:57037 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 07:17:15 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:15 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:15.580674 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:15.576103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:55807)
0811 07:17:15.576241 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:15.576256 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:15.576326 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:15.576461 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:15.576462 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:15.576634 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:15.576690 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:15.576692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.577341 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.577341 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:15.577855 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:15.577856 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.578213 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.578214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:15.578273 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:15.578781 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:15.578785 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:15.580612 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
W20260811 07:17:15.580776 25443 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:15.576176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:55807 (local address 127.9.142.190:41211)
0811 07:17:15.576325 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:15.576326 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:15.576336 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:17:15.576374 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:15.576375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:15.576388 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:15.576445 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:15.576753 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.577274 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.577933 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.578148 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.578205 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:15.580702 (+ 2497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:55807: BlockingRecv error: recv got EOF from 127.9.142.129:55807 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
Aug 11 07:17:15 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:15 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:15.711995 25444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:15.707331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:39307)
0811 07:17:15.707488 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:15.707499 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:15.707559 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:15.707685 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:15.707686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:15.707866 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:15.707927 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:15.707929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.708555 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.708555 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:15.709082 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:15.709083 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.709479 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.709480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:15.709524 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:15.710070 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:15.710075 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:15.711936 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
W20260811 07:17:15.712121 25443 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:15.707425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:39307 (local address 127.9.142.190:41211)
0811 07:17:15.707501 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:15.707502 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:15.707555 (+ 53us) server_negotiation.cc:407] Connection header received
0811 07:17:15.707605 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:15.707606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:15.707617 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:15.707667 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:15.707984 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.708490 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.709198 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.709408 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.709471 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:15.712049 (+ 2578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:39307: BlockingRecv error: recv got EOF from 127.9.142.130:39307 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 07:17:15 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:15 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:15.860829 25445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:15.855390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:53485)
0811 07:17:15.855588 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:15.855604 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:15.855673 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:15.855947 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:15.855948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:15.856149 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:15.856205 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:15.856206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.856956 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.856957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:15.857591 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:15.857592 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.857987 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.857989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:15.858057 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:15.858574 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:15.858579 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:15.860762 (+ 2183us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":118,"threads_started":1}
W20260811 07:17:15.860917 25443 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:15.855557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:53485 (local address 127.9.142.190:41211)
0811 07:17:15.855633 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:15.855635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:15.855649 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:17:15.855775 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:15.855776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:15.855794 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:15.855926 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:15.856300 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.856852 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.857686 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:15.857905 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:15.857990 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:15.860864 (+ 2874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:53485: BlockingRecv error: recv got EOF from 127.9.142.131:53485 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 07:17:16 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:16 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:16.590441 25446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:16.581215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:46609)
0811 07:17:16.581386 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:16.581403 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:16.581456 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:16.581614 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:16.581615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:16.581794 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:16.581874 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:16.581876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.582658 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.582660 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:16.583451 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:16.583454 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.583869 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.583870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:16.583915 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:16.588495 (+ 4580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:16.588500 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:16.590364 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":125,"threads_started":1}
W20260811 07:17:16.590541 25448 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:16.581338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:46609 (local address 127.9.142.190:41211)
0811 07:17:16.581479 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:16.581481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:16.581490 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:16.581515 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:16.581516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:16.581527 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:16.581600 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:16.581944 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.582511 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.583530 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.583791 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.583853 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:16.590464 (+ 6611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:46609: BlockingRecv error: recv got EOF from 127.9.142.129:46609 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":76,"threads_started":1}
Aug 11 07:17:16 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:16 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:16.717314 25449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:16.712523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:33185)
0811 07:17:16.712699 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:16.712711 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:16.712787 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:16.712950 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:16.712951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:16.713187 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:16.713244 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:16.713246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.713902 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.713903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:16.714456 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:16.714457 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.714803 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.714804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:16.714862 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:16.715342 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:16.715347 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:16.717251 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":93,"threads_started":1}
W20260811 07:17:16.717425 25448 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:16.712601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:33185 (local address 127.9.142.190:41211)
0811 07:17:16.712653 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:16.712656 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:16.712776 (+ 120us) server_negotiation.cc:407] Connection header received
0811 07:17:16.712852 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:16.712852 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:16.712868 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:16.712930 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:16.713314 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.713824 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.714528 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.714715 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.714772 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:16.717346 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:33185: BlockingRecv error: recv got EOF from 127.9.142.130:33185 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 07:17:16 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:16 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:16.866556 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:16.861410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:39175)
0811 07:17:16.861577 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:16.861589 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:16.861680 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:16.861830 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:16.861831 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:16.862094 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:16.862148 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:16.862150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.862832 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.862833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:16.863374 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:16.863375 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.863765 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.863766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:16.863842 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:16.864467 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:16.864473 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:16.866469 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
W20260811 07:17:16.866652 25448 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:16.861477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:39175 (local address 127.9.142.190:41211)
0811 07:17:16.861557 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:16.861560 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:16.861658 (+ 98us) server_negotiation.cc:407] Connection header received
0811 07:17:16.861738 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:16.861740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:16.861759 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:16.861821 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:16.862236 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.862750 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.863472 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:16.863665 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:16.863743 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:16.866585 (+ 2842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:39175: BlockingRecv error: recv got EOF from 127.9.142.131:39175 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 07:17:17 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:17 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:17.595569 25455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:17.591000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:53167)
0811 07:17:17.591159 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:17.591170 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:17.591222 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:17.591371 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:17.591372 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:17.591541 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:17.591597 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:17.591598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.592283 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.592284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:17.592817 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:17.592818 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.593149 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.593149 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:17.593191 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:17.593701 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:17.593706 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:17.595508 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
W20260811 07:17:17.595707 25456 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:17.591058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:53167 (local address 127.9.142.190:41211)
0811 07:17:17.591210 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:17.591212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:17.591221 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:17.591278 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:17.591278 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:17.591289 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:17.591351 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:17.591655 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.592219 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.592901 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.593089 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.593139 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:17.595599 (+ 2460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:53167: BlockingRecv error: recv got EOF from 127.9.142.129:53167 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":97,"threads_started":1}
Aug 11 07:17:17 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:17 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:17.723327 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:17.717880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:50759)
0811 07:17:17.718179 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:17.718193 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:17.718289 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:17.718450 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:17.718451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:17.718648 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:17.718703 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:17.718705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.719424 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.719426 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:17.720040 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:17.720042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.720420 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.720422 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:17.720485 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:17.721012 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:17.721017 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:17.723260 (+ 2243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":105,"threads_started":1}
W20260811 07:17:17.723645 25456 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:17.717995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:50759 (local address 127.9.142.190:41211)
0811 07:17:17.718183 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:17.718186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:17.718271 (+ 85us) server_negotiation.cc:407] Connection header received
0811 07:17:17.718368 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:17.718369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:17.718384 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:17.718433 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:17.718784 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.719331 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.720127 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.720326 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.720419 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:17.723555 (+ 3136us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:50759: BlockingRecv error: recv got EOF from 127.9.142.130:50759 (error 108)
Metrics: {"server-negotiator.queue_time_us":158}
Aug 11 07:17:17 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:17 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:17.872597 25458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:17.867186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:41693)
0811 07:17:17.867369 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:17.867382 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:17.867459 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:17.867663 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:17.867665 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:17.867898 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:17.867958 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:17.867960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.868703 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.868704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:17.869312 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:17.869314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.869702 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.869703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:17.869754 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:17.870334 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:17.870340 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:17.872529 (+ 2189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":96,"threads_started":1}
W20260811 07:17:17.872788 25456 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:17.867246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:41693 (local address 127.9.142.190:41211)
0811 07:17:17.867325 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:17.867328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:17.867486 (+ 158us) server_negotiation.cc:407] Connection header received
0811 07:17:17.867525 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:17.867526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:17.867543 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:17.867611 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:17.868040 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.868610 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.869423 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:17.869621 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:17.869686 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:17.872671 (+ 2985us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:41693: BlockingRecv error: recv got EOF from 127.9.142.131:41693 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 07:17:18 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:18 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:18.601086 25459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:18.596097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:56245)
0811 07:17:18.596248 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:18.596261 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:18.596325 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:18.596468 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:18.596469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:18.596647 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:18.596702 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:18.596704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.597511 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.597512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:18.598197 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:18.598200 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.598573 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.598574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:18.598618 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:18.599134 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:18.599145 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:18.601022 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
W20260811 07:17:18.601267 25461 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:18.596155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:56245 (local address 127.9.142.190:41211)
0811 07:17:18.596316 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:18.596318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:18.596329 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:17:18.596384 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:18.596385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:18.596395 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:18.596446 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:18.596762 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.597418 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.598312 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.598509 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.598564 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:18.601176 (+ 2612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:56245: BlockingRecv error: recv got EOF from 127.9.142.129:56245 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":97,"threads_started":1}
Aug 11 07:17:18 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:18 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:18.729076 25463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:18.723988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:56739)
0811 07:17:18.724167 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:18.724183 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:18.724260 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:18.724418 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:18.724420 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:18.724623 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:18.724681 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:18.724683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.725361 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.725362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:18.725900 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:18.725901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.726263 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.726265 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:18.726331 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:18.726856 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:18.726860 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:18.729010 (+ 2150us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":110,"threads_started":1}
W20260811 07:17:18.729189 25461 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:18.724141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:56739 (local address 127.9.142.190:41211)
0811 07:17:18.724203 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:18.724206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:18.724239 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:17:18.724327 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:18.724328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:18.724346 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:18.724408 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:18.724766 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.725275 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.725990 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.726189 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.726265 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:18.729116 (+ 2851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:56739: BlockingRecv error: recv got EOF from 127.9.142.130:56739 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 07:17:18 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:18 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:18.878710 25466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:18.873200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:56235)
0811 07:17:18.873361 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:18.873381 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:18.873446 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:18.873676 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:18.873677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:18.873959 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:18.874048 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:18.874051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.875058 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.875059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:18.875666 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:18.875668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.876118 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.876152 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:18.876213 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:18.876725 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:18.876730 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:18.878647 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
W20260811 07:17:18.878906 25461 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:18.873313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:56235 (local address 127.9.142.190:41211)
0811 07:17:18.873438 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:18.873440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:18.873452 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:17:18.873513 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:18.873514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:18.873533 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:18.873580 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:18.874144 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.874932 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.875811 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:18.876038 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:18.876105 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:18.878778 (+ 2673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:56235: BlockingRecv error: recv got EOF from 127.9.142.131:56235 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 11 07:17:19 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:19 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:19.607007 25467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:19.601640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:47967)
0811 07:17:19.601839 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:19.601851 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:19.601950 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:19.602155 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:19.602157 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:19.602381 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:19.602439 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:19.602441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.603131 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.603132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:19.603703 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:19.603705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.604177 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.604177 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:19.604228 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:19.604876 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:19.604881 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:19.606892 (+ 2011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":100,"threads_started":1}
W20260811 07:17:19.607059 25468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:19.601709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:47967 (local address 127.9.142.190:41211)
0811 07:17:19.601937 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:19.601939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:19.601949 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:17:19.602027 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:19.602028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:19.602041 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:19.602119 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:19.602520 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.603035 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.603877 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.604107 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.604165 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:19.606980 (+ 2815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:47967: BlockingRecv error: recv got EOF from 127.9.142.129:47967 (error 108)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":105,"threads_started":1}
Aug 11 07:17:19 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:19 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:19.735786 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:19.729796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:34471)
0811 07:17:19.730027 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:19.730040 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:19.730112 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:19.730284 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:19.730285 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:19.730721 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:19.730817 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:19.730824 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.732023 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.732026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:19.732604 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:19.732606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.733022 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.733023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:19.733091 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:19.733655 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:19.733660 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:19.735655 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":167,"threads_started":1}
W20260811 07:17:19.735847 25468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:19.730009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:34471 (local address 127.9.142.190:41211)
0811 07:17:19.730097 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:19.730100 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:19.730112 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:17:19.730182 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:19.730183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:19.730197 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:19.730276 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:19.731055 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.731906 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.732717 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.732922 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.733005 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:19.735777 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:34471: BlockingRecv error: recv got EOF from 127.9.142.130:34471 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 07:17:19 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:19 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:19.885604 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:19.879396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:36029)
0811 07:17:19.879526 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:19.879538 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:19.879628 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:19.879817 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:19.879818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:19.880019 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:19.880072 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:19.880074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.880783 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.880784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:19.881866 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:19.881870 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.882485 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.882486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:19.882572 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:19.883184 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:19.883192 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:19.885506 (+ 2314us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":74,"threads_started":1}
W20260811 07:17:19.885937 25468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:19.879467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:36029 (local address 127.9.142.190:41211)
0811 07:17:19.879539 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:19.879541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:19.879624 (+ 83us) server_negotiation.cc:407] Connection header received
0811 07:17:19.879714 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:19.879715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:19.879729 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:19.879805 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:19.880177 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.880695 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.881998 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:19.882381 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:19.882458 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:19.885869 (+ 3411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:36029: BlockingRecv error: recv got EOF from 127.9.142.131:36029 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 07:17:20 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:20 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:20.613983 25472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:20.607646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:57115)
0811 07:17:20.607843 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:20.607858 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:20.607945 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:20.608152 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:20.608154 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:20.608345 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:20.608415 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:20.608417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.609561 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.609564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:20.610515 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:20.610519 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.610971 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.610972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:20.611051 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:20.611658 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:20.611663 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:20.613912 (+ 2249us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":129,"threads_started":1}
W20260811 07:17:20.614143 25474 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:20.607798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:57115 (local address 127.9.142.190:41211)
0811 07:17:20.607982 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:20.607983 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:20.607995 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:17:20.608023 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:20.608023 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:20.608035 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:20.608102 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:20.608526 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.609395 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.610622 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.610855 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.610927 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:20.614033 (+ 3106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:57115: BlockingRecv error: recv got EOF from 127.9.142.129:57115 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":111,"threads_started":1}
Aug 11 07:17:20 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:20 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:20.741080 25475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:20.736398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:34739)
0811 07:17:20.736591 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:20.736608 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:20.736661 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:20.736800 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:20.736801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:20.736982 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:20.737041 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:20.737043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.737683 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.737684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:20.738232 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:20.738233 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.738584 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.738585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:20.738630 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:20.739076 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:20.739080 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:20.740979 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":121,"threads_started":1}
W20260811 07:17:20.741127 25474 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:20.736499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:34739 (local address 127.9.142.190:41211)
0811 07:17:20.736571 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:20.736573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:20.736670 (+ 97us) server_negotiation.cc:407] Connection header received
0811 07:17:20.736711 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:20.736712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:20.736724 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:20.736789 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:20.737107 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.737607 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.738320 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.738511 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.738567 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:20.741063 (+ 2496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:34739: BlockingRecv error: recv got EOF from 127.9.142.130:34739 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 07:17:20 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:20 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:20.893247 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:20.887660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:60861)
0811 07:17:20.887880 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:20.887894 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:20.888016 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:20.888210 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:20.888211 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:20.888457 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:20.888543 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:20.888548 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.889317 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.889319 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:20.889949 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:20.889952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.890383 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.890385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:20.890451 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:20.890968 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:20.890973 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:20.893137 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":115,"threads_started":1}
W20260811 07:17:20.893304 25474 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:20.887783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:60861 (local address 127.9.142.190:41211)
0811 07:17:20.887854 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:20.887857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:20.887993 (+ 136us) server_negotiation.cc:407] Connection header received
0811 07:17:20.888104 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:20.888105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:20.888121 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:20.888200 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:20.888641 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.889208 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.890058 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:20.890274 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:20.890382 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:20.893229 (+ 2847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:60861: BlockingRecv error: recv got EOF from 127.9.142.131:60861 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 07:17:21 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:21 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:21.625166 25487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:21.614599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:44163)
0811 07:17:21.614789 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:21.614805 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:21.614877 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:21.615070 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:21.615071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:21.615254 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:21.615311 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:21.615313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.616000 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.616001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:21.616657 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:21.616661 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.617010 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.617011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:21.617053 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:21.623104 (+ 6051us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:21.623108 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:21.625103 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":80,"threads_started":1}
W20260811 07:17:21.625353 25488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:21.614769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:44163 (local address 127.9.142.190:41211)
0811 07:17:21.614941 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:21.614943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:21.614953 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:17:21.614977 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:21.614977 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:21.614987 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:21.615048 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:21.615383 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.615922 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.616744 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.616937 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.616998 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:21.625237 (+ 8239us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:44163: BlockingRecv error: recv got EOF from 127.9.142.129:44163 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":116,"threads_started":1}
Aug 11 07:17:21 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:21 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:21.746497 25491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:21.741637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:50587)
0811 07:17:21.741847 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:21.741861 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:21.741931 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:21.742111 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:21.742112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:21.742290 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:21.742346 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:21.742348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.743129 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.743129 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:21.743659 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:21.743661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.744004 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.744005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:21.744046 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:21.744508 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:21.744512 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:21.746383 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":103,"threads_started":1}
W20260811 07:17:21.746537 25488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:21.741753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:50587 (local address 127.9.142.190:41211)
0811 07:17:21.741800 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:21.741803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:21.741937 (+ 134us) server_negotiation.cc:407] Connection header received
0811 07:17:21.742014 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:21.742015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:21.742028 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:21.742083 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:21.742420 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.743059 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.743753 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.743937 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.743988 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:21.746471 (+ 2483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:50587: BlockingRecv error: recv got EOF from 127.9.142.130:50587 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 11 07:17:21 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:21 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:21.898978 25494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:21.893766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:40877)
0811 07:17:21.893993 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:21.894010 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:21.894073 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:21.894195 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:21.894196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:21.894386 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:21.894442 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:21.894444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.895147 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.895148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:21.895788 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:21.895790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.896142 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.896143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:21.896188 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:21.896828 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:21.896834 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:21.898869 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":168,"threads_started":1}
W20260811 07:17:21.898993 25488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:21.893864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:40877 (local address 127.9.142.190:41211)
0811 07:17:21.893936 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:21.893938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:21.894068 (+ 130us) server_negotiation.cc:407] Connection header received
0811 07:17:21.894125 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:21.894126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:21.894139 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:21.894189 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:21.894543 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.895066 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.895881 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:21.896068 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:21.896125 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:21.898929 (+ 2804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:40877: BlockingRecv error: recv got EOF from 127.9.142.131:40877 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 07:17:22 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:22 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:22.630707 25498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:22.625730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:59755)
0811 07:17:22.625945 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:22.625956 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:22.626008 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:22.626156 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:22.626157 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:22.626354 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:22.626408 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:22.626409 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.627159 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.627161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:22.627696 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:22.627697 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.628121 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.628122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:22.628165 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:22.628728 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:22.628733 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:22.630643 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":145,"threads_started":1}
W20260811 07:17:22.630904 25499 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:22.625840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:59755 (local address 127.9.142.190:41211)
0811 07:17:22.625990 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:22.625992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:22.626006 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:17:22.626057 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:22.626057 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:22.626067 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:22.626133 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:22.626507 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.627059 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.627834 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.628047 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.628105 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:22.630769 (+ 2664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:59755: BlockingRecv error: recv got EOF from 127.9.142.129:59755 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
Aug 11 07:17:22 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:22 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:22.752220 25501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:22.747026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:44563)
0811 07:17:22.747324 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:22.747341 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:22.747415 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:22.747571 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:22.747572 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:22.747837 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:22.747905 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:22.747907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.748579 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.748580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:22.749181 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:22.749182 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.749529 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.749529 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:22.749614 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:22.750094 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:22.750099 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:22.752156 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":237,"threads_started":1}
W20260811 07:17:22.752357 25499 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:22.747157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:44563 (local address 127.9.142.190:41211)
0811 07:17:22.747268 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:22.747270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:22.747412 (+ 142us) server_negotiation.cc:407] Connection header received
0811 07:17:22.747468 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:22.747469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:22.747479 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:22.747542 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:22.747975 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.748496 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.749266 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.749455 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.749519 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:22.752250 (+ 2731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:44563: BlockingRecv error: recv got EOF from 127.9.142.130:44563 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 07:17:22 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:22 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:22.905145 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:22.899570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:59939)
0811 07:17:22.899845 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:22.899857 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:22.899945 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:22.900113 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:22.900114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:22.900318 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:22.900369 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:22.900371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.901071 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.901073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:22.901601 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:22.901603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.901983 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.901985 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:22.902043 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:22.902599 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:22.902606 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:22.905080 (+ 2474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":138,"threads_started":1}
W20260811 07:17:22.905305 25499 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:22.899712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:59939 (local address 127.9.142.190:41211)
0811 07:17:22.899793 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:22.899795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:22.899923 (+ 128us) server_negotiation.cc:407] Connection header received
0811 07:17:22.900015 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:22.900016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:22.900035 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:22.900103 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:22.900465 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.900982 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.901696 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:22.901887 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:22.901978 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:22.905222 (+ 3244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:59939: BlockingRecv error: recv got EOF from 127.9.142.131:59939 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 07:17:23 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:23 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:23.635860 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:23.631285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:39451)
0811 07:17:23.631461 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:23.631473 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:23.631534 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:23.631672 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:23.631673 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:23.631874 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:23.631931 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:23.631932 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.632616 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.632617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:23.633156 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:23.633157 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.633487 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.633488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:23.633529 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:23.633978 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:23.633982 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:23.635725 (+ 1743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":112,"threads_started":1}
W20260811 07:17:23.635979 25505 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:23.631403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:39451 (local address 127.9.142.190:41211)
0811 07:17:23.631545 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:23.631547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:23.631554 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:17:23.631580 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:23.631580 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:23.631591 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:23.631654 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:23.632003 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.632522 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.633230 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.633417 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.633468 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:23.635865 (+ 2397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:39451: BlockingRecv error: recv got EOF from 127.9.142.129:39451 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
Aug 11 07:17:23 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:23 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:23.757386 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:23.752721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:43853)
0811 07:17:23.752873 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:23.752883 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:23.752947 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:23.753105 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:23.753106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:23.753283 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:23.753339 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:23.753341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.754037 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.754038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:23.754559 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:23.754561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.754899 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.754900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:23.754942 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:23.755444 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:23.755449 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:23.757324 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":59,"threads_started":1}
W20260811 07:17:23.757537 25505 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:23.752823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:43853 (local address 127.9.142.190:41211)
0811 07:17:23.752919 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:23.752921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:23.752933 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:17:23.752998 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:23.752999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:23.753010 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:23.753059 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:23.753455 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.753960 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.754642 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.754830 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.754888 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:23.757448 (+ 2560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:43853: BlockingRecv error: recv got EOF from 127.9.142.130:43853 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 11 07:17:23 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:23 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:17:23.910526 25505 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:23.905774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:51289 (local address 127.9.142.190:41211)
0811 07:17:23.905823 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:23.905824 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:23.905860 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:17:23.905940 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:23.905940 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:23.905953 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:23.906001 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:23.906342 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.906873 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.907548 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.907727 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.907859 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:23.910470 (+ 2611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:51289: BlockingRecv error: recv got EOF from 127.9.142.131:51289 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:17:23.910527 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:23.905639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:51289)
0811 07:17:23.905797 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:23.905811 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:23.905883 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:23.906020 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:23.906021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:23.906224 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:23.906277 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:23.906279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.906953 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.906954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:23.907478 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:23.907479 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:23.907868 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:23.907869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:23.907926 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:23.908432 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:23.908437 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:23.910395 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
Aug 11 07:17:24 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:24 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:24.641219 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:24.636319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:33581)
0811 07:17:24.636611 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:24.636622 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:24.636688 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:24.636828 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:24.636829 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:24.637023 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:24.637078 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:24.637079 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.637734 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.637735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:24.638268 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:24.638270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.638632 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.638633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:24.638701 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:24.639239 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:24.639244 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:24.641142 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":208,"threads_started":1}
W20260811 07:17:24.641348 25512 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:24.636505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:33581 (local address 127.9.142.190:41211)
0811 07:17:24.636615 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:24.636618 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:24.636691 (+ 73us) server_negotiation.cc:407] Connection header received
0811 07:17:24.636744 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:24.636744 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:24.636755 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:24.636807 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:24.637145 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.637661 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.638342 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.638537 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.638628 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:24.641237 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:33581: BlockingRecv error: recv got EOF from 127.9.142.129:33581 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":54,"threads_started":1}
Aug 11 07:17:24 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:24 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:24.763118 25513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:24.757955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:50457)
0811 07:17:24.758089 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:24.758102 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:24.758203 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:24.758368 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:24.758369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:24.758595 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:24.758648 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:24.758651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.759319 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.759320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:24.759994 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:24.759996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.760410 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.760411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:24.760451 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:24.761086 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:24.761091 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:24.763044 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":71,"threads_started":1}
W20260811 07:17:24.763392 25512 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:24.758024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:50457 (local address 127.9.142.190:41211)
0811 07:17:24.758081 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:24.758083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:24.758179 (+ 96us) server_negotiation.cc:407] Connection header received
0811 07:17:24.758265 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:24.758266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:24.758281 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:24.758337 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:24.758718 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.759236 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.760068 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.760343 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.760399 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:24.763297 (+ 2898us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:50457: BlockingRecv error: recv got EOF from 127.9.142.130:50457 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 07:17:24 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:24 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:24.916443 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:24.911059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:40545)
0811 07:17:24.911265 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:24.911277 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:24.911385 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:24.911579 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:24.911580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:24.911819 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:24.911869 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:24.911871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.912565 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.912566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:24.913117 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:24.913119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.913496 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.913497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:24.913556 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:24.914049 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:24.914054 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:24.916369 (+ 2315us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":119,"threads_started":1}
W20260811 07:17:24.916513 25512 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:24.911150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:40545 (local address 127.9.142.190:41211)
0811 07:17:24.911245 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:24.911248 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:24.911368 (+ 120us) server_negotiation.cc:407] Connection header received
0811 07:17:24.911471 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:24.911472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:24.911487 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:24.911567 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:24.911962 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.912472 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.913212 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:24.913410 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:24.913496 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:24.916463 (+ 2967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:40545: BlockingRecv error: recv got EOF from 127.9.142.131:40545 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 07:17:25 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:25 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:25.646562 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:25.641789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:49593)
0811 07:17:25.641924 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:25.641937 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:25.641998 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:25.642122 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:25.642123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:25.642304 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:25.642354 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:25.642355 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.643009 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.643010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:25.643556 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:25.643559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.643996 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.643997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:25.644039 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:25.644516 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:25.644520 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:25.646499 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
W20260811 07:17:25.646677 25518 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:25.641838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:49593 (local address 127.9.142.190:41211)
0811 07:17:25.641995 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:25.641997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:25.642006 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:25.642047 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:25.642047 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:25.642058 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:25.642118 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:25.642418 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.642917 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.643638 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.643918 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.643982 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:25.646596 (+ 2614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:49593: BlockingRecv error: recv got EOF from 127.9.142.129:49593 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
Aug 11 07:17:25 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:25 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:25.768528 25521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:25.763649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:57543)
0811 07:17:25.763857 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:25.763874 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:25.763937 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:25.764149 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:25.764151 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:25.764351 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:25.764413 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:25.764415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.765095 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.765096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:25.765700 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:25.765702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.766038 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.766039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:25.766081 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:25.766618 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:25.766623 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:25.768467 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":145,"threads_started":1}
W20260811 07:17:25.768677 25518 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:25.763717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:57543 (local address 127.9.142.190:41211)
0811 07:17:25.763853 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:25.763855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:25.763936 (+ 81us) server_negotiation.cc:407] Connection header received
0811 07:17:25.763986 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:25.763987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:25.763999 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:25.764058 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:25.764500 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.765019 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.765781 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.765966 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.766024 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:25.768594 (+ 2570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:57543: BlockingRecv error: recv got EOF from 127.9.142.130:57543 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 11 07:17:25 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:25 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:25.922369 25522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:25.917023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:42787)
0811 07:17:25.917230 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:25.917242 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:25.917335 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:25.917509 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:25.917510 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:25.917713 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:25.917761 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:25.917763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.918469 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.918471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:25.919049 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:25.919051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.919413 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.919414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:25.919456 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:25.920041 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:25.920046 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:25.922252 (+ 2206us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":102,"threads_started":1}
W20260811 07:17:25.922389 25518 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:25.917123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:42787 (local address 127.9.142.190:41211)
0811 07:17:25.917226 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:25.917228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:25.917312 (+ 84us) server_negotiation.cc:407] Connection header received
0811 07:17:25.917402 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:25.917403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:25.917417 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:25.917493 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:25.917848 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.918377 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.919139 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:25.919338 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:25.919403 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:25.922332 (+ 2929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:42787: BlockingRecv error: recv got EOF from 127.9.142.131:42787 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 07:17:26 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:26 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:26.656034 25523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:26.647154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:60953)
0811 07:17:26.647331 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:26.647345 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:26.647409 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:26.647573 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:26.647574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:26.647819 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:26.647873 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:26.647874 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.648560 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.648561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:26.649209 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:26.649212 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.649725 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.649726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:26.649795 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:26.654024 (+ 4229us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:26.654029 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:26.655926 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":75,"threads_started":1}
W20260811 07:17:26.656111 25524 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:26.647215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:60953 (local address 127.9.142.190:41211)
0811 07:17:26.647382 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:26.647384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:26.647393 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:26.647478 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:26.647478 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:26.647490 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:26.647553 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:26.647937 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.648460 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.649338 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.649646 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.649723 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:26.656036 (+ 6313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:60953: BlockingRecv error: recv got EOF from 127.9.142.129:60953 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":99,"threads_started":1}
Aug 11 07:17:26 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:26 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:26.774327 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:26.769072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:45383)
0811 07:17:26.769226 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:26.769237 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:26.769288 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:26.769513 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:26.769515 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:26.769711 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:26.769793 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:26.769795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.770616 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.770617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:26.771162 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:26.771163 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.771586 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.771587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:26.771632 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:26.772113 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:26.772118 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:26.774259 (+ 2141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
W20260811 07:17:26.774714 25524 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:26.769228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:45383 (local address 127.9.142.190:41211)
0811 07:17:26.769297 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:26.769299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:26.769307 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:26.769352 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:26.769353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:26.769363 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:26.769438 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:26.769913 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.770523 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.771234 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.771500 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.771570 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:26.774615 (+ 3045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:45383: BlockingRecv error: recv got EOF from 127.9.142.130:45383 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 07:17:26 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:26 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:26.927809 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:26.922961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:43017)
0811 07:17:26.923133 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:26.923147 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:26.923228 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:26.923358 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:26.923359 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:26.923562 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:26.923612 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:26.923614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.924327 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.924329 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:26.924878 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:26.924880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.925260 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.925261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:26.925318 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:26.925830 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:26.925837 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:26.927667 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":96,"threads_started":1}
W20260811 07:17:26.927827 25524 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:26.922991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:43017 (local address 127.9.142.190:41211)
0811 07:17:26.923080 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:26.923082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:26.923210 (+ 128us) server_negotiation.cc:407] Connection header received
0811 07:17:26.923284 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:26.923285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:26.923300 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:26.923353 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:26.923696 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.924239 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.924969 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:26.925182 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:26.925262 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:26.927760 (+ 2498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:43017: BlockingRecv error: recv got EOF from 127.9.142.131:43017 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 07:17:27 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:27 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:27.662793 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:27.656634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:53637)
0811 07:17:27.656803 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:27.656818 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:27.656891 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:27.657080 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:27.657081 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:27.657268 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:27.657321 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:27.657322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.658790 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.658792 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:27.659433 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:27.659435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.660063 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.660064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:27.660111 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:27.660663 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:27.660670 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:27.662726 (+ 2056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
W20260811 07:17:27.663051 25531 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:27.656712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:53637 (local address 127.9.142.190:41211)
0811 07:17:27.656911 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:27.656914 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:27.656928 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:17:27.656963 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:27.656963 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:27.656979 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:27.657065 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:27.657574 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.658672 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.659532 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.659970 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.660051 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:27.662871 (+ 2820us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:53637: BlockingRecv error: recv got EOF from 127.9.142.129:53637 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":74,"threads_started":1}
Aug 11 07:17:27 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:27 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:27.780135 25532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:27.775189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:55999)
0811 07:17:27.775356 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:27.775444 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:27.775530 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:27.775672 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:27.775672 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:27.775923 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:27.775979 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:27.775981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.776657 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.776657 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:27.777207 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:27.777208 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.777539 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.777540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:27.777586 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:27.778133 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:27.778138 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:27.780060 (+ 1922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
W20260811 07:17:27.780207 25531 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:27.775269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:55999 (local address 127.9.142.190:41211)
0811 07:17:27.775339 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:27.775340 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:27.775535 (+ 195us) server_negotiation.cc:407] Connection header received
0811 07:17:27.775583 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:27.775584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:27.775596 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:27.775651 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:27.776064 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.776584 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.777279 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.777470 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.777522 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:27.780158 (+ 2636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:55999: BlockingRecv error: recv got EOF from 127.9.142.130:55999 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 07:17:27 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:27 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.131@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:27.932884 25533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:27.928377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.131:48801)
0811 07:17:27.928580 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:27.928591 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:27.928653 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:27.928781 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:27.928782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:27.928963 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:27.929017 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:27.929019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.929645 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.929646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:27.930161 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:27.930162 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.930474 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.930475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:27.930522 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:27.930976 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:27.930980 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:27.932824 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":132,"threads_started":1}
W20260811 07:17:27.933024 25531 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:27.928432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:48801 (local address 127.9.142.190:41211)
0811 07:17:27.928506 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:27.928509 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:27.928655 (+ 146us) server_negotiation.cc:407] Connection header received
0811 07:17:27.928698 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:27.928699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:27.928712 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:27.928759 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:27.929083 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.929579 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.930232 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:27.930408 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:27.930459 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:27.932910 (+ 2451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.131:48801: BlockingRecv error: recv got EOF from 127.9.142.131:48801 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 07:17:28 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:28 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.129@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:28.668887 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:28.663385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.129:38499)
0811 07:17:28.663616 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:28.663630 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:28.663697 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:28.663900 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:28.663900 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:28.664074 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:28.664127 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:28.664128 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:28.664816 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:28.664817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:28.665352 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:28.665353 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:28.665819 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:28.665820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:28.665866 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:28.666401 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:28.666406 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:28.668817 (+ 2411us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":142,"threads_started":1}
W20260811 07:17:28.669016 25537 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:28.663563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:38499 (local address 127.9.142.190:41211)
0811 07:17:28.663767 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:28.663769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:28.663778 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:17:28.663802 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:28.663802 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:28.663813 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:28.663881 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:28.664211 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:28.664738 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:28.665537 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:28.665742 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:28.665805 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:28.668934 (+ 3129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.129:38499: BlockingRecv error: recv got EOF from 127.9.142.129:38499 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":91,"threads_started":1}
Aug 11 07:17:28 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:17:28 dist-test-slave-7f01 krb5kdc[23747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.142.130@KRBTEST.COM for oryx/127.9.142.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:17:28.785604 25538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:28.780710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41211 (local address 127.9.142.130:35501)
0811 07:17:28.780887 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:28.780901 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:28.781002 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:28.781149 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:28.781150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:28.781347 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:28.781399 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:28.781402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:28.782111 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:28.782112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:28.782656 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:28.782657 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:28.783044 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:28.783045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:28.783110 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:28.783610 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:28.783615 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:28.785544 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.142.190:41211: Server oryx/127.9.142.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":92,"threads_started":1}
W20260811 07:17:28.785733 25537 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:28.780822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:35501 (local address 127.9.142.190:41211)
0811 07:17:28.780906 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:28.780908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:28.780982 (+ 74us) server_negotiation.cc:407] Connection header received
0811 07:17:28.781080 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:28.781081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:28.781093 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:28.781146 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:28.781484 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:28.782012 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:28.782750 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:28.782961 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:28.783044 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:28.785648 (+ 2604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.142.130:35501: BlockingRecv error: recv got EOF from 127.9.142.130:35501 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:17:28.841377 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 24689
I20260811 07:17:28.853694 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 24958
I20260811 07:17:28.868865 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 25199
I20260811 07:17:28.876600 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 24578
2026-08-11T07:17:28Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17869 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T07:17:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:17:28Z Disabled control of system clock
I20260811 07:17:28.916563 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:37247
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:34157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:37247
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 07:17:29.002763 25542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:29.002966 25542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:29.002986 25542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:29.004227 25542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:29.004268 25542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:29.004282 25542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:29.004323 25542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:29.004350 25542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:29.005714 25542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:37247
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:37247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:29.005977 25542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:29.006284 25542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:29.011687 25551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.011674 25552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.011750 25542 server_base.cc:1034] running on GCE node
W20260811 07:17:29.011664 25554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.012233 25542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:29.012540 25542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:29.013712 25542 hybrid_clock.cc:648] HybridClock initialized: now 1786432649013702 us; error 43 us; skew 500 ppm
I20260811 07:17:29.015019 25542 webserver.cc:460] Webserver started at http://127.9.142.190:35967/ using document root <none> and password file <none>
I20260811 07:17:29.015280 25542 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:29.015368 25542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:29.015522 25542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:29.016633 25542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "609044e5a41f482ab16f2cba4e48baed"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "633e64c310f075da350b12ff644716d4"
server_key_iv: "d2e338088050c2709e8452e1fd3d556e"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.017000 25542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "609044e5a41f482ab16f2cba4e48baed"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "633e64c310f075da350b12ff644716d4"
server_key_iv: "d2e338088050c2709e8452e1fd3d556e"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.018311 25542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:17:29.019053 25563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.019251 25542 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:29.019375 25542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "609044e5a41f482ab16f2cba4e48baed"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "633e64c310f075da350b12ff644716d4"
server_key_iv: "d2e338088050c2709e8452e1fd3d556e"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.019454 25542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:29.034878 25542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:29.035185 25542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:29.035341 25542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:29.039604 25542 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:37247
I20260811 07:17:29.039637 25659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:37247 every 8 connection(s)
I20260811 07:17:29.040094 25542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:17:29.040920 25660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:29.041345 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 25542
I20260811 07:17:29.041460 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:17:29.041728 9786 external_mini_cluster.cc:1428] Setting key 49144ee93ada5ff01f2138d54e6d3cfe
I20260811 07:17:29.044693 25660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed: Bootstrap starting.
I20260811 07:17:29.045469 25660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:29.045815 25660 log.cc:824] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:29.046610 25660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed: No bootstrap required, opened a new log
I20260811 07:17:29.048513 25665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.042445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47454 (local address 127.9.142.190:37247)
0811 07:17:29.042719 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:29.042728 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:29.043315 (+ 587us) server_negotiation.cc:407] Connection header received
0811 07:17:29.043797 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:29.043805 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:29.043881 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:29.043991 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:29.044246 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.045242 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.046403 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.046856 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.046962 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:29.047656 (+ 694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:29.047660 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:29.047660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:17:29.047882 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:29.047917 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:17:29.047932 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:29.047993 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:29.048124 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 07:17:29.048319 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":108,"threads_started":1}
I20260811 07:17:29.049361 25660 raft_consensus.cc:348] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609044e5a41f482ab16f2cba4e48baed" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37247 } }
I20260811 07:17:29.049521 25660 raft_consensus.cc:374] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:29.049568 25660 raft_consensus.cc:729] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 609044e5a41f482ab16f2cba4e48baed, State: Initialized, Role: FOLLOWER
I20260811 07:17:29.049715 25660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609044e5a41f482ab16f2cba4e48baed" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37247 } }
I20260811 07:17:29.049801 25660 raft_consensus.cc:388] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:17:29.049853 25660 raft_consensus.cc:482] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:17:29.049903 25660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:29.050513 25660 raft_consensus.cc:504] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609044e5a41f482ab16f2cba4e48baed" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37247 } }
I20260811 07:17:29.050639 25660 leader_election.cc:302] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 609044e5a41f482ab16f2cba4e48baed; no voters:
I20260811 07:17:29.050824 25660 leader_election.cc:288] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:17:29.050868 25669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:29.051044 25669 raft_consensus.cc:686] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [term 1 LEADER]: Becoming Leader. State: Replica: 609044e5a41f482ab16f2cba4e48baed, State: Running, Role: LEADER
I20260811 07:17:29.051103 25660 sys_catalog.cc:564] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:29.051182 25669 consensus_queue.cc:237] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609044e5a41f482ab16f2cba4e48baed" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37247 } }
I20260811 07:17:29.051672 25672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 609044e5a41f482ab16f2cba4e48baed. Latest consensus state: current_term: 1 leader_uuid: "609044e5a41f482ab16f2cba4e48baed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609044e5a41f482ab16f2cba4e48baed" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37247 } } }
I20260811 07:17:29.051817 25672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:29.052059 25681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:17:29.052054 25671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "609044e5a41f482ab16f2cba4e48baed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609044e5a41f482ab16f2cba4e48baed" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37247 } } }
I20260811 07:17:29.052217 25671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:29.052640 25681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:17:29.054247 25681 catalog_manager.cc:1347] Generated new cluster ID: 68f4209b853245738cf2c88f1ed42b7f
I20260811 07:17:29.054325 25681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:17:29.063038 25681 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:17:29.063535 25681 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:17:29.079669 25681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 609044e5a41f482ab16f2cba4e48baed: Generated new TSK 0
I20260811 07:17:29.079914 25681 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:17:29.083331 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37247
--builtin_ntp_servers=127.9.142.148:34157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 07:17:29.176959 25696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:29.177160 25696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:29.177182 25696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:29.178314 25696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:29.178354 25696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:29.178378 25696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:17:29.179695 25696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:29.179986 25696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:29.180321 25696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:29.185496 25703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.185506 25705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.185631 25709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.186079 25696 server_base.cc:1034] running on GCE node
I20260811 07:17:29.186308 25696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:29.186581 25696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:29.187793 25696 hybrid_clock.cc:648] HybridClock initialized: now 1786432649187761 us; error 44 us; skew 500 ppm
I20260811 07:17:29.189174 25696 webserver.cc:460] Webserver started at http://127.9.142.129:35967/ using document root <none> and password file <none>
I20260811 07:17:29.189471 25696 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:29.189523 25696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:29.189659 25696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:29.190735 25696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "d7fb99fb52b94e07bf91146bd246ae1e"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "2eb21536621c9a0761f2aca08bd8bd15"
server_key_iv: "d7e43a856deca1290e4e7e4c1d945b07"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.191135 25696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "d7fb99fb52b94e07bf91146bd246ae1e"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "2eb21536621c9a0761f2aca08bd8bd15"
server_key_iv: "d7e43a856deca1290e4e7e4c1d945b07"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.192584 25696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:17:29.193393 25721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.193590 25696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:29.193692 25696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "d7fb99fb52b94e07bf91146bd246ae1e"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "2eb21536621c9a0761f2aca08bd8bd15"
server_key_iv: "d7e43a856deca1290e4e7e4c1d945b07"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.193773 25696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:29.221282 25696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:29.221674 25696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:29.221851 25696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:29.222124 25696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:29.222561 25696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:29.222623 25696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.222667 25696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:29.222693 25696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.229156 25696 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:37165
I20260811 07:17:29.229224 25910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:37165 every 8 connection(s)
I20260811 07:17:29.229612 25696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:17:29.230374 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 25696
I20260811 07:17:29.230471 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:17:29.230717 9786 external_mini_cluster.cc:1428] Setting key 04983f1c4836b02d4bd8868aa1f2973f
I20260811 07:17:29.231813 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37247
--builtin_ntp_servers=127.9.142.148:34157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 07:17:29.235530 25665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.230538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:58237 (local address 127.9.142.190:37247)
0811 07:17:29.230618 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:29.230620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:29.231132 (+ 512us) server_negotiation.cc:407] Connection header received
0811 07:17:29.231613 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:29.231614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:29.231627 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:29.231684 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:29.232494 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.233001 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.234033 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.234246 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.234327 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:29.235245 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:29.235247 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:29.235247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:17:29.235252 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:29.235270 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:17:29.235274 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:29.235322 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:29.235401 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 07:17:29.235445 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:17:29.235787 25914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.230506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:37247 (local address 127.9.142.129:58237)
0811 07:17:29.230849 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:29.230911 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:29.231519 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:29.231777 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:29.231781 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:29.231792 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:29.232381 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:29.232387 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.233108 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.233109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:29.233914 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:29.233917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.234337 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.234338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:29.234487 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:29.235079 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:17:29.235080 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:29.235110 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:17:29.235133 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:29.235322 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:29.235328 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:29.235331 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:17:29.235402 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 07:17:29.235506 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":93,"threads_started":1}
I20260811 07:17:29.236323 25912 heartbeater.cc:347] Connected to a master server at 127.9.142.190:37247
I20260811 07:17:29.236423 25912 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:29.236640 25912 heartbeater.cc:511] Master 127.9.142.190:37247 requested a full tablet report, sending...
I20260811 07:17:29.237286 25588 ts_manager.cc:194] Registered new tserver with Master: d7fb99fb52b94e07bf91146bd246ae1e (127.9.142.129:37165)
I20260811 07:17:29.238313 25588 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.129:58237
W20260811 07:17:29.318207 25915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:29.318413 25915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:29.318434 25915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:29.319501 25915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:29.319532 25915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:29.319556 25915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:17:29.320873 25915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:29.321058 25915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:29.321287 25915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:29.326506 25927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.326500 25932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.326500 25928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.326534 25915 server_base.cc:1034] running on GCE node
I20260811 07:17:29.326957 25915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:29.327152 25915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:29.328333 25915 hybrid_clock.cc:648] HybridClock initialized: now 1786432649328317 us; error 51 us; skew 500 ppm
I20260811 07:17:29.329691 25915 webserver.cc:460] Webserver started at http://127.9.142.130:41665/ using document root <none> and password file <none>
I20260811 07:17:29.329936 25915 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:29.330009 25915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:29.330199 25915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:29.331574 25915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "e7fcc11c64354c8dba240d3c80370a62"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "12b9867a0b267dac5b902b5d1c418439"
server_key_iv: "a0f3e90988bfef8a8e743cfde77023cf"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.332000 25915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "e7fcc11c64354c8dba240d3c80370a62"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "12b9867a0b267dac5b902b5d1c418439"
server_key_iv: "a0f3e90988bfef8a8e743cfde77023cf"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.333333 25915 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:29.334105 25939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.334290 25915 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:29.334411 25915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "e7fcc11c64354c8dba240d3c80370a62"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "12b9867a0b267dac5b902b5d1c418439"
server_key_iv: "a0f3e90988bfef8a8e743cfde77023cf"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.334491 25915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:29.347824 25915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:29.348119 25915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:29.348268 25915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:29.348500 25915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:29.348829 25915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:29.348888 25915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.348930 25915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:29.348956 25915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.355257 25915 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:41931
I20260811 07:17:29.355315 26146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:41931 every 8 connection(s)
I20260811 07:17:29.355634 25915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:17:29.357858 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 25915
I20260811 07:17:29.357967 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:17:29.358186 9786 external_mini_cluster.cc:1428] Setting key 3893ac50210c578671ba0177366bae13
I20260811 07:17:29.359269 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37247
--builtin_ntp_servers=127.9.142.148:34157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 07:17:29.361900 25665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.356401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:54101 (local address 127.9.142.190:37247)
0811 07:17:29.356451 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:29.356454 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:29.356674 (+ 220us) server_negotiation.cc:407] Connection header received
0811 07:17:29.357223 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:29.357225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:29.357238 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:29.357296 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:29.358225 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.358855 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.360378 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.360561 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.360612 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:29.361625 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:29.361626 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:29.361627 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:17:29.361631 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:29.361648 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:17:29.361652 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:29.361706 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:29.361787 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 07:17:29.361819 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:17:29.362134 26150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.356364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:37247 (local address 127.9.142.130:54101)
0811 07:17:29.356546 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:29.356580 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:29.357112 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:29.357362 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:29.357367 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:29.357377 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:29.358113 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:29.358121 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.358981 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.358983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:29.360271 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:29.360275 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.360655 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.360656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:29.360820 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:29.361474 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:17:29.361475 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:29.361505 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:17:29.361527 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:29.361719 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:29.361724 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:29.361727 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:17:29.361792 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 07:17:29.361893 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":71,"threads_started":1}
I20260811 07:17:29.362612 26148 heartbeater.cc:347] Connected to a master server at 127.9.142.190:37247
I20260811 07:17:29.362720 26148 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:29.362959 26148 heartbeater.cc:511] Master 127.9.142.190:37247 requested a full tablet report, sending...
I20260811 07:17:29.363348 25588 ts_manager.cc:194] Registered new tserver with Master: e7fcc11c64354c8dba240d3c80370a62 (127.9.142.130:41931)
I20260811 07:17:29.363785 25588 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.130:54101
W20260811 07:17:29.445500 26154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:29.445695 26154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:29.445716 26154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:29.446802 26154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:29.446835 26154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:29.446859 26154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:17:29.448180 26154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:29.448367 26154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:29.448597 26154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:29.453900 26168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.453876 26165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.453877 26154 server_base.cc:1034] running on GCE node
W20260811 07:17:29.453877 26164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.454367 26154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:29.454622 26154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:29.455804 26154 hybrid_clock.cc:648] HybridClock initialized: now 1786432649455787 us; error 27 us; skew 500 ppm
I20260811 07:17:29.457176 26154 webserver.cc:460] Webserver started at http://127.9.142.131:39171/ using document root <none> and password file <none>
I20260811 07:17:29.457440 26154 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:29.457520 26154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:29.457681 26154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:29.458751 26154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "8329b2c64e4a4bec9977792413bff896"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "1295cd6214eec86e0b8bd0d1e472f791"
server_key_iv: "9a8a8687af30414d643dc36843a90f97"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.459128 26154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "8329b2c64e4a4bec9977792413bff896"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "1295cd6214eec86e0b8bd0d1e472f791"
server_key_iv: "9a8a8687af30414d643dc36843a90f97"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.460583 26154 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:17:29.461351 26177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.461557 26154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:29.461673 26154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "8329b2c64e4a4bec9977792413bff896"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "1295cd6214eec86e0b8bd0d1e472f791"
server_key_iv: "9a8a8687af30414d643dc36843a90f97"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.461752 26154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:29.476171 26154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:29.476485 26154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:29.476647 26154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:29.476879 26154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:29.477216 26154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:29.477278 26154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.477314 26154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:29.477341 26154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.483194 26154 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:38631
I20260811 07:17:29.483240 26366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:38631 every 8 connection(s)
I20260811 07:17:29.483598 26154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:17:29.485668 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 26154
I20260811 07:17:29.485750 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:17:29.485981 9786 external_mini_cluster.cc:1428] Setting key 38bfe7483ec4e24421a1fafbce58ddbb
I20260811 07:17:29.489106 25665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.484415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:50443 (local address 127.9.142.190:37247)
0811 07:17:29.484476 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:29.484478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:29.484706 (+ 228us) server_negotiation.cc:407] Connection header received
0811 07:17:29.485193 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:29.485194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:29.485204 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:29.485260 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:29.486015 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.486686 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.487777 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.487981 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.488043 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:29.488894 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:29.488895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:29.488895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:17:29.488898 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:29.488911 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:17:29.488914 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:29.488954 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:29.489026 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 07:17:29.489046 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 07:17:29.489315 26372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.484377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:37247 (local address 127.9.142.131:50443)
0811 07:17:29.484568 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:29.484610 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:29.485108 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:29.485315 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:29.485318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:29.485327 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:29.485912 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:29.485918 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.486788 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.486789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:29.487665 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:29.487668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:29.488066 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:29.488066 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:29.488175 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:29.488765 (+ 590us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:17:29.488766 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:29.488793 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:17:29.488815 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:29.488956 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:29.488958 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:29.488960 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:17:29.489004 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 07:17:29.489078 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260811 07:17:29.489898 26368 heartbeater.cc:347] Connected to a master server at 127.9.142.190:37247
I20260811 07:17:29.489979 26368 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:29.490121 26368 heartbeater.cc:511] Master 127.9.142.190:37247 requested a full tablet report, sending...
I20260811 07:17:29.490468 25588 ts_manager.cc:194] Registered new tserver with Master: 8329b2c64e4a4bec9977792413bff896 (127.9.142.131:38631)
I20260811 07:17:29.490800 25588 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.131:50443
I20260811 07:17:29.497960 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:17:29.499838 25665 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:29.499271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47464 (local address 127.9.142.190:37247)
0811 07:17:29.499336 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:29.499337 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:29.499454 (+ 117us) server_negotiation.cc:407] Connection header received
0811 07:17:29.499516 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:29.499517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:29.499525 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:29.499566 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:29.499744 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47464: BlockingRecv error: recv got EOF from 127.0.0.1:47464 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:17:29.499879 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 25696
I20260811 07:17:29.515167 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 25915
I20260811 07:17:29.532912 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 26154
I20260811 07:17:29.540194 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 25542
2026-08-11T07:17:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (656 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T07:17:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:17:29Z Disabled control of system clock
I20260811 07:17:29.572464 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45307
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:45307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 07:17:29.655781 26383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:29.655977 26383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:29.656006 26383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:29.657245 26383 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:29.657289 26383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:29.657302 26383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:29.657315 26383 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:29.657372 26383 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:29.658679 26383 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:45307
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:29.658939 26383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:29.659242 26383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:29.664294 26394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.664327 26383 server_base.cc:1034] running on GCE node
W20260811 07:17:29.664259 26401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.664294 26395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.664791 26383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:29.665113 26383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:29.666272 26383 hybrid_clock.cc:648] HybridClock initialized: now 1786432649666255 us; error 36 us; skew 500 ppm
I20260811 07:17:29.667510 26383 webserver.cc:460] Webserver started at http://127.9.142.190:42717/ using document root <none> and password file <none>
I20260811 07:17:29.667815 26383 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:29.667866 26383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:29.668078 26383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:29.669174 26383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "b6234ac8b65948768fe63340e2f992d7"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "10b7c0875876ce80e8cc31a2d10cbaff"
server_key_iv: "452bab38e71e897f5764d9ed7ac0ebd0"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.669551 26383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "b6234ac8b65948768fe63340e2f992d7"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "10b7c0875876ce80e8cc31a2d10cbaff"
server_key_iv: "452bab38e71e897f5764d9ed7ac0ebd0"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.670816 26383 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:17:29.671520 26412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.671689 26383 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:29.671823 26383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "b6234ac8b65948768fe63340e2f992d7"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "10b7c0875876ce80e8cc31a2d10cbaff"
server_key_iv: "452bab38e71e897f5764d9ed7ac0ebd0"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.671906 26383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:29.675292 26383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:29.675558 26383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:29.675709 26383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:29.679785 26383 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:45307
I20260811 07:17:29.679819 26492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:45307 every 8 connection(s)
I20260811 07:17:29.680151 26383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:17:29.680840 26493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:29.683492 26493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7: Bootstrap starting.
I20260811 07:17:29.684104 26493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:29.684374 26493 log.cc:824] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:29.685009 26493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7: No bootstrap required, opened a new log
I20260811 07:17:29.686650 26493 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234ac8b65948768fe63340e2f992d7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45307 } }
I20260811 07:17:29.686854 26493 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:29.686903 26493 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6234ac8b65948768fe63340e2f992d7, State: Initialized, Role: FOLLOWER
I20260811 07:17:29.686967 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 26383
I20260811 07:17:29.687062 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:17:29.687063 26493 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234ac8b65948768fe63340e2f992d7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45307 } }
I20260811 07:17:29.687158 26493 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:17:29.687196 26493 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:17:29.687247 26493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:29.687286 9786 external_mini_cluster.cc:1428] Setting key 3a9deaad725ce4aac2e61b88fb2690d5
I20260811 07:17:29.687985 26493 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234ac8b65948768fe63340e2f992d7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45307 } }
I20260811 07:17:29.688107 26493 leader_election.cc:302] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6234ac8b65948768fe63340e2f992d7; no voters:
I20260811 07:17:29.688283 26493 leader_election.cc:288] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:17:29.688313 26503 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:29.688421 26503 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [term 1 LEADER]: Becoming Leader. State: Replica: b6234ac8b65948768fe63340e2f992d7, State: Running, Role: LEADER
I20260811 07:17:29.688512 26503 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234ac8b65948768fe63340e2f992d7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45307 } }
I20260811 07:17:29.688552 26493 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:29.688859 26503 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6234ac8b65948768fe63340e2f992d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234ac8b65948768fe63340e2f992d7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45307 } } }
I20260811 07:17:29.688942 26503 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:29.689079 26503 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6234ac8b65948768fe63340e2f992d7. Latest consensus state: current_term: 1 leader_uuid: "b6234ac8b65948768fe63340e2f992d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6234ac8b65948768fe63340e2f992d7" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45307 } } }
I20260811 07:17:29.689152 26503 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7 [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:29.689440 26511 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:17:29.690035 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.687885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44356 (local address 127.9.142.190:45307)
0811 07:17:29.688160 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:29.688169 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:29.688204 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:17:29.688305 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:29.688309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:29.688372 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:29.688549 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:29.689305 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:29.689311 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:29.689311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:17:29.689317 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:29.689392 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:17:29.689421 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:29.689728 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:29.689765 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 07:17:29.689825 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":117,"threads_started":1}
I20260811 07:17:29.690033 26511 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:17:29.692108 26511 catalog_manager.cc:1347] Generated new cluster ID: d58d4eb03f0847498828e1647a7cf9fe
I20260811 07:17:29.692166 26511 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:17:29.701589 26511 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:17:29.701781 26511 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:17:29.707795 26511 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6234ac8b65948768fe63340e2f992d7: Generated new TSK 0
I20260811 07:17:29.708006 26511 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:17:29.714872 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45307
--builtin_ntp_servers=127.9.142.148:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 07:17:29.810153 26531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:29.810365 26531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:29.810387 26531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:29.811685 26531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:29.811828 26531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:29.811861 26531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:17:29.813251 26531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:29.813526 26531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:29.813831 26531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:29.819861 26542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.819787 26543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.819787 26547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.820256 26531 server_base.cc:1034] running on GCE node
I20260811 07:17:29.820482 26531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:29.820721 26531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:29.821888 26531 hybrid_clock.cc:648] HybridClock initialized: now 1786432649821872 us; error 34 us; skew 500 ppm
I20260811 07:17:29.823220 26531 webserver.cc:460] Webserver started at http://127.9.142.129:36617/ using document root <none> and password file <none>
I20260811 07:17:29.823487 26531 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:29.823568 26531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:29.823709 26531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:29.824846 26531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "f21de4b7b89d4ab2b6ac3fe99c4ab5da"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "41107a70e8ca4ab7bf15c99835b8b558"
server_key_iv: "7d86214a2fc5b52eae84466ea9fee49a"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.825225 26531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "f21de4b7b89d4ab2b6ac3fe99c4ab5da"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "41107a70e8ca4ab7bf15c99835b8b558"
server_key_iv: "7d86214a2fc5b52eae84466ea9fee49a"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.826561 26531 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:17:29.827353 26565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.827570 26531 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:29.827674 26531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "f21de4b7b89d4ab2b6ac3fe99c4ab5da"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "41107a70e8ca4ab7bf15c99835b8b558"
server_key_iv: "7d86214a2fc5b52eae84466ea9fee49a"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.827771 26531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:29.831625 26531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:29.831924 26531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:29.832031 26531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:29.832192 26531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:29.832444 26531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:29.832474 26531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.832502 26531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:29.832515 26531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.838454 26531 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:40097
I20260811 07:17:29.838532 26758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:40097 every 8 connection(s)
I20260811 07:17:29.838892 26531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:17:29.841418 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 26531
I20260811 07:17:29.841534 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:17:29.841797 9786 external_mini_cluster.cc:1428] Setting key 6b3a505ac2e0609d953fe3b21f929f72
I20260811 07:17:29.842352 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.839693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:44827 (local address 127.9.142.190:45307)
0811 07:17:29.839878 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:29.839881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:29.840082 (+ 201us) server_negotiation.cc:407] Connection header received
0811 07:17:29.840531 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:29.840532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:29.840537 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:29.840590 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:29.842066 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:29.842068 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:29.842068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:17:29.842073 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:29.842093 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:17:29.842098 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:29.842156 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:29.842269 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 07:17:29.842287 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260811 07:17:29.842548 26764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.839645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45307 (local address 127.9.142.129:44827)
0811 07:17:29.839963 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:29.839997 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:29.840441 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:29.840640 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:29.840643 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:29.840651 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:29.841888 (+ 1237us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:17:29.841889 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:29.841927 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:17:29.841961 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:29.842175 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:29.842183 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:29.842186 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:17:29.842258 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 07:17:29.842320 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":224,"threads_started":1}
I20260811 07:17:29.842973 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45307
--builtin_ntp_servers=127.9.142.148:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 07:17:29.843341 26759 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45307
I20260811 07:17:29.843422 26759 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:29.843582 26759 heartbeater.cc:511] Master 127.9.142.190:45307 requested a full tablet report, sending...
I20260811 07:17:29.844156 26441 ts_manager.cc:194] Registered new tserver with Master: f21de4b7b89d4ab2b6ac3fe99c4ab5da (127.9.142.129:40097)
W20260811 07:17:29.940224 26765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:29.940426 26765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:29.940449 26765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:29.941555 26765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:29.941588 26765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:29.941612 26765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:17:29.942862 26765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:29.943045 26765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:29.943281 26765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:17:29.948499 26765 server_base.cc:1034] running on GCE node
W20260811 07:17:29.948472 26772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.948436 26776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:29.948450 26774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:29.948859 26765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:29.949168 26765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:29.950364 26765 hybrid_clock.cc:648] HybridClock initialized: now 1786432649950366 us; error 45 us; skew 500 ppm
I20260811 07:17:29.951658 26765 webserver.cc:460] Webserver started at http://127.9.142.130:33107/ using document root <none> and password file <none>
I20260811 07:17:29.951947 26765 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:29.952045 26765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:29.952203 26765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:29.953248 26765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "98357d3e01064bf59ccc8fb5fe41774f"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "cba51ba64c28357cf12e2d9f1eced60c"
server_key_iv: "ce31f68f9579fa70c150f34e79f900c6"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.953608 26765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "98357d3e01064bf59ccc8fb5fe41774f"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "cba51ba64c28357cf12e2d9f1eced60c"
server_key_iv: "ce31f68f9579fa70c150f34e79f900c6"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.954923 26765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:17:29.955685 26785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.955936 26765 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:29.956053 26765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "98357d3e01064bf59ccc8fb5fe41774f"
format_stamp: "Formatted at 2026-08-11 07:17:29 on dist-test-slave-7f01"
server_key: "cba51ba64c28357cf12e2d9f1eced60c"
server_key_iv: "ce31f68f9579fa70c150f34e79f900c6"
server_key_version: "encryptionkey@0"
I20260811 07:17:29.956135 26765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:29.959414 26765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:29.959677 26765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:29.959844 26765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:29.960076 26765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:29.960397 26765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:29.960454 26765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.960493 26765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:29.960521 26765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:29.966794 26765 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:37597
I20260811 07:17:29.966848 26959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:37597 every 8 connection(s)
I20260811 07:17:29.967206 26765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:17:29.970136 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.968054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:60223 (local address 127.9.142.190:45307)
0811 07:17:29.968135 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:29.968137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:29.968332 (+ 195us) server_negotiation.cc:407] Connection header received
0811 07:17:29.968778 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:29.968779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:29.968783 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:29.968841 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:29.969908 (+ 1067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:29.969909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:29.969909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:17:29.969913 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:29.969929 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:17:29.969945 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:29.969994 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:29.970067 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 07:17:29.970080 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:17:29.970330 26962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:29.968004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45307 (local address 127.9.142.130:60223)
0811 07:17:29.968188 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:29.968228 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:29.968694 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:29.968890 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:29.968892 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:29.968901 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:29.969765 (+ 864us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:17:29.969766 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:29.969793 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:17:29.969821 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:29.969999 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:29.970002 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:29.970004 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:17:29.970055 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 07:17:29.970101 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260811 07:17:29.970811 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 26765
I20260811 07:17:29.970898 26960 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45307
I20260811 07:17:29.970919 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:17:29.970999 26960 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:29.971151 26960 heartbeater.cc:511] Master 127.9.142.190:45307 requested a full tablet report, sending...
I20260811 07:17:29.971156 9786 external_mini_cluster.cc:1428] Setting key e18f318c66021f56db0407b534e4fc26
I20260811 07:17:29.971556 26438 ts_manager.cc:194] Registered new tserver with Master: 98357d3e01064bf59ccc8fb5fe41774f (127.9.142.130:37597)
I20260811 07:17:29.972234 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45307
--builtin_ntp_servers=127.9.142.148:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 07:17:30.063058 26963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:30.063254 26963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:30.063277 26963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:30.064435 26963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:30.064476 26963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:30.064502 26963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:17:30.065748 26963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:30.065943 26963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:30.066169 26963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:30.071282 26973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:30.071277 26972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:30.071336 26975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:30.071470 26963 server_base.cc:1034] running on GCE node
I20260811 07:17:30.071792 26963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:30.072055 26963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:30.073185 26963 hybrid_clock.cc:648] HybridClock initialized: now 1786432650073173 us; error 31 us; skew 500 ppm
I20260811 07:17:30.074571 26963 webserver.cc:460] Webserver started at http://127.9.142.131:37301/ using document root <none> and password file <none>
I20260811 07:17:30.074806 26963 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:30.074852 26963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:30.075019 26963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:30.076257 26963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "fe60d4462c6d45bf825a9f9baeb9a8ab"
format_stamp: "Formatted at 2026-08-11 07:17:30 on dist-test-slave-7f01"
server_key: "e31f1243d47702c8c6d1ace88ca9e240"
server_key_iv: "9975fd03c4c51bda6d4b6a962d1969b3"
server_key_version: "encryptionkey@0"
I20260811 07:17:30.076624 26963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "fe60d4462c6d45bf825a9f9baeb9a8ab"
format_stamp: "Formatted at 2026-08-11 07:17:30 on dist-test-slave-7f01"
server_key: "e31f1243d47702c8c6d1ace88ca9e240"
server_key_iv: "9975fd03c4c51bda6d4b6a962d1969b3"
server_key_version: "encryptionkey@0"
I20260811 07:17:30.077872 26963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:17:30.078639 26983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:30.078811 26963 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:30.078934 26963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "fe60d4462c6d45bf825a9f9baeb9a8ab"
format_stamp: "Formatted at 2026-08-11 07:17:30 on dist-test-slave-7f01"
server_key: "e31f1243d47702c8c6d1ace88ca9e240"
server_key_iv: "9975fd03c4c51bda6d4b6a962d1969b3"
server_key_version: "encryptionkey@0"
I20260811 07:17:30.079016 26963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:30.082461 26963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:30.082741 26963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:30.082894 26963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:30.083122 26963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:30.083455 26963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:30.083518 26963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:30.083557 26963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:30.083585 26963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:30.089859 26963 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:38629
I20260811 07:17:30.089897 27180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:38629 every 8 connection(s)
I20260811 07:17:30.090276 26963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:17:30.093412 26500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:30.091052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:58435 (local address 127.9.142.190:45307)
0811 07:17:30.091119 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:30.091121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:30.091354 (+ 233us) server_negotiation.cc:407] Connection header received
0811 07:17:30.091926 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:30.091927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:30.091935 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:30.091986 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:30.093138 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:30.093140 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:30.093140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:17:30.093144 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:30.093161 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:17:30.093166 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:30.093220 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:30.093320 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 07:17:30.093338 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 07:17:30.093583 27184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:30.091026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45307 (local address 127.9.142.131:58435)
0811 07:17:30.091233 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:30.091265 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:30.091804 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:30.092060 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:30.092064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:30.092073 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:30.092974 (+ 901us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:17:30.092975 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:30.093010 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:17:30.093036 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:30.093236 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:30.093241 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:30.093244 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:17:30.093315 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 07:17:30.093378 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
I20260811 07:17:30.094107 27181 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45307
I20260811 07:17:30.094198 27181 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:30.094323 27181 heartbeater.cc:511] Master 127.9.142.190:45307 requested a full tablet report, sending...
I20260811 07:17:30.094723 26438 ts_manager.cc:194] Registered new tserver with Master: fe60d4462c6d45bf825a9f9baeb9a8ab (127.9.142.131:38629)
I20260811 07:17:30.098270 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 26963
I20260811 07:17:30.098361 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:17:30.098526 9786 external_mini_cluster.cc:1428] Setting key c9353869fe5d28e2ecfb86c2a683c86a
I20260811 07:17:30.099476 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:17:30.101481 26500 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:17:30.100897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44370 (local address 127.9.142.190:45307)
0811 07:17:30.100982 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:30.100984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:30.101098 (+ 114us) server_negotiation.cc:407] Connection header received
0811 07:17:30.101193 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:30.101194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:30.101200 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:30.101280 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:30.101415 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44370: BlockingRecv error: recv got EOF from 127.0.0.1:44370 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 07:17:30.101570 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 26531
I20260811 07:17:30.122782 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 26765
I20260811 07:17:30.147626 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 26963
I20260811 07:17:30.155874 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 26383
2026-08-11T07:17:30Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (618 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:17:30 dist-test-slave-7f01 krb5kdc[27198](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:17:30 dist-test-slave-7f01 krb5kdc[27198](info): set up 2 sockets
Aug 11 07:17:30 dist-test-slave-7f01 krb5kdc[27198](info): commencing operation
krb5kdc: starting...
W20260811 07:17:31.430516 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:17:31 dist-test-slave-7f01 krb5kdc[27198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:17:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:17:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:17:31.556699 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33583
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:33583
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:31.640137 27226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:31.640348 27226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:31.640370 27226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:31.641549 27226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:17:31.641595 27226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:31.641610 27226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:31.641623 27226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:17:31.641635 27226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:17:31.643124 27226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:33583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:31.643392 27226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:31.643641 27226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:31.648644 27231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:31.648629 27237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:31.648618 27232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:31.648972 27226 server_base.cc:1034] running on GCE node
I20260811 07:17:31.649256 27226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:31.649595 27226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:31.650769 27226 hybrid_clock.cc:648] HybridClock initialized: now 1786432651650738 us; error 42 us; skew 500 ppm
Aug 11 07:17:31 dist-test-slave-7f01 krb5kdc[27198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432651, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:31.653393 27226 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:17:31.653848 27226 webserver.cc:460] Webserver started at http://127.9.142.190:46351/ using document root <none> and password file <none>
I20260811 07:17:31.654096 27226 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:31.654172 27226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:31.654336 27226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:31.655402 27226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "afd0221fc8cb45a6b29cf491f44f149b"
format_stamp: "Formatted at 2026-08-11 07:17:31 on dist-test-slave-7f01"
server_key: "7c4b18d7120c5441302d66936fafc8a0"
server_key_iv: "00bc8ddbcdb95b2a644bf0467a7a2c95"
server_key_version: "encryptionkey@0"
I20260811 07:17:31.655864 27226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "afd0221fc8cb45a6b29cf491f44f149b"
format_stamp: "Formatted at 2026-08-11 07:17:31 on dist-test-slave-7f01"
server_key: "7c4b18d7120c5441302d66936fafc8a0"
server_key_iv: "00bc8ddbcdb95b2a644bf0467a7a2c95"
server_key_version: "encryptionkey@0"
I20260811 07:17:31.657208 27226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:31.657939 27251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:31.658133 27226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:17:31.658257 27226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "afd0221fc8cb45a6b29cf491f44f149b"
format_stamp: "Formatted at 2026-08-11 07:17:31 on dist-test-slave-7f01"
server_key: "7c4b18d7120c5441302d66936fafc8a0"
server_key_iv: "00bc8ddbcdb95b2a644bf0467a7a2c95"
server_key_version: "encryptionkey@0"
I20260811 07:17:31.658349 27226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:31.682777 27226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:31.684762 27226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:31.684960 27226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:31.689153 27226 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:33583
I20260811 07:17:31.689208 27321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:33583 every 8 connection(s)
I20260811 07:17:31.689595 27226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:17:31.690649 27322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:31.691879 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 27226
I20260811 07:17:31.691987 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:17:31.692169 9786 external_mini_cluster.cc:1428] Setting key 566132fd38267e6b1a074cb94585e28a
I20260811 07:17:31.693642 27322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b: Bootstrap starting.
I20260811 07:17:31.694303 27322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:31.694665 27322 log.cc:824] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:31.695502 27322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b: No bootstrap required, opened a new log
I20260811 07:17:31.697885 27322 raft_consensus.cc:348] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afd0221fc8cb45a6b29cf491f44f149b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33583 } }
I20260811 07:17:31.698074 27322 raft_consensus.cc:374] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:31.698122 27322 raft_consensus.cc:729] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afd0221fc8cb45a6b29cf491f44f149b, State: Initialized, Role: FOLLOWER
I20260811 07:17:31.698297 27322 consensus_queue.cc:260] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afd0221fc8cb45a6b29cf491f44f149b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33583 } }
I20260811 07:17:31.698397 27322 raft_consensus.cc:388] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:17:31.698422 27322 raft_consensus.cc:482] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:17:31.698496 27322 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:31.699054 27322 raft_consensus.cc:504] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afd0221fc8cb45a6b29cf491f44f149b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33583 } }
I20260811 07:17:31.699205 27322 leader_election.cc:302] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afd0221fc8cb45a6b29cf491f44f149b; no voters:
I20260811 07:17:31.699401 27322 leader_election.cc:288] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:17:31.699457 27331 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:31.699625 27331 raft_consensus.cc:686] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [term 1 LEADER]: Becoming Leader. State: Replica: afd0221fc8cb45a6b29cf491f44f149b, State: Running, Role: LEADER
I20260811 07:17:31.699719 27322 sys_catalog.cc:564] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:17:31.699797 27331 consensus_queue.cc:237] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afd0221fc8cb45a6b29cf491f44f149b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33583 } }
Aug 11 07:17:31 dist-test-slave-7f01 krb5kdc[27198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:31.700273 27331 sys_catalog.cc:455] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [sys.catalog]: SysCatalogTable state changed. Reason: New leader afd0221fc8cb45a6b29cf491f44f149b. Latest consensus state: current_term: 1 leader_uuid: "afd0221fc8cb45a6b29cf491f44f149b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afd0221fc8cb45a6b29cf491f44f149b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33583 } } }
I20260811 07:17:31.700440 27331 sys_catalog.cc:458] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:31.700506 27333 sys_catalog.cc:455] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afd0221fc8cb45a6b29cf491f44f149b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afd0221fc8cb45a6b29cf491f44f149b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33583 } } }
I20260811 07:17:31.700620 27333 sys_catalog.cc:458] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b [sys.catalog]: This master's current role is: LEADER
I20260811 07:17:31.700789 27347 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:17:31.701333 27347 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:17:31.703234 27347 catalog_manager.cc:1347] Generated new cluster ID: d7cb9e44f9fe4ad3bd542238d78639e3
I20260811 07:17:31.703291 27347 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:17:31.704289 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:31.692744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55304 (local address 127.9.142.190:33583)
0811 07:17:31.692982 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:31.692992 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:31.693026 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:17:31.693570 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:31.693580 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:31.693639 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:31.693786 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:31.694406 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:31.695908 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:31.696688 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:31.697386 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:31.697527 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:31.700514 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:31.700519 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:31.700520 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:31.700538 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:31.702653 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:31.703030 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:31.703033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:31.703033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:31.703164 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:31.703410 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:31.703411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:31.703411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:31.703645 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:31.703822 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:31.703949 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 07:17:31.704092 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":129,"threads_started":1}
I20260811 07:17:31.716902 27347 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:17:31.717613 27347 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:17:31.726265 27347 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b: Generated new TSK 0
I20260811 07:17:31.726447 27347 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:17:31.758181 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33583
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:31.844169 27369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:31.844378 27369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:31.844403 27369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:31.845578 27369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:31.845624 27369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:31.845651 27369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:17:31.847182 27369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:31.847445 27369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:31.847705 27369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:17:31.852921 27369 server_base.cc:1034] running on GCE node
W20260811 07:17:31.852874 27376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:31.852891 27380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:31.852927 27384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:31.853312 27369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:31.853600 27369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:31.854775 27369 hybrid_clock.cc:648] HybridClock initialized: now 1786432651854763 us; error 45 us; skew 500 ppm
Aug 11 07:17:31 dist-test-slave-7f01 krb5kdc[27198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432651, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:31.857316 27369 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:17:31.857760 27369 webserver.cc:460] Webserver started at http://127.9.142.129:37093/ using document root <none> and password file <none>
I20260811 07:17:31.858024 27369 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:31.858103 27369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:31.858264 27369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:31.859357 27369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "08c8d70a447f4ba5886276d474bbefd9"
format_stamp: "Formatted at 2026-08-11 07:17:31 on dist-test-slave-7f01"
server_key: "34acc9560364e8e583c613d4893bbbae"
server_key_iv: "474ce2a8c2693e1ce724fec7c2ff01f0"
server_key_version: "encryptionkey@0"
I20260811 07:17:31.859812 27369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "08c8d70a447f4ba5886276d474bbefd9"
format_stamp: "Formatted at 2026-08-11 07:17:31 on dist-test-slave-7f01"
server_key: "34acc9560364e8e583c613d4893bbbae"
server_key_iv: "474ce2a8c2693e1ce724fec7c2ff01f0"
server_key_version: "encryptionkey@0"
I20260811 07:17:31.861295 27369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:31.862169 27395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:31.862375 27369 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:31.862496 27369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "08c8d70a447f4ba5886276d474bbefd9"
format_stamp: "Formatted at 2026-08-11 07:17:31 on dist-test-slave-7f01"
server_key: "34acc9560364e8e583c613d4893bbbae"
server_key_iv: "474ce2a8c2693e1ce724fec7c2ff01f0"
server_key_version: "encryptionkey@0"
I20260811 07:17:31.862591 27369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:31.874182 27369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:31.876087 27369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:31.876276 27369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:31.876555 27369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:31.876937 27369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:31.876991 27369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:31.877024 27369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:31.877053 27369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:31.885517 27369 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:45479
I20260811 07:17:31.885564 27565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:45479 every 8 connection(s)
I20260811 07:17:31.885895 27369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
Aug 11 07:17:31 dist-test-slave-7f01 krb5kdc[27198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432651, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:31.893989 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 27369
I20260811 07:17:31.894098 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:17:31.894306 9786 external_mini_cluster.cc:1428] Setting key 1e86e37c294ec2cfa9ec39fea3119184
I20260811 07:17:31.895699 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:31.886607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:57123 (local address 127.9.142.190:33583)
0811 07:17:31.886677 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:31.886679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:31.886898 (+ 219us) server_negotiation.cc:407] Connection header received
0811 07:17:31.887504 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:31.887506 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:31.887521 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:31.887572 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:31.888620 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:31.889144 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:31.890171 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:31.890399 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:31.890482 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:31.892684 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:31.892685 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:31.892685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:31.892692 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:31.893916 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:31.894472 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:31.894472 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:31.894473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:31.894568 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:31.894981 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:31.894982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:31.894983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:31.895118 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:31.895205 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:31.895511 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 07:17:31.895606 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 07:17:31.896014 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:31.886586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33583 (local address 127.9.142.129:57123)
0811 07:17:31.886761 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:31.886809 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:31.887362 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:31.887646 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:31.887654 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:31.888310 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:31.888505 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:31.888510 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:31.889257 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:31.889258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:31.890065 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:31.890067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:31.890492 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:31.890493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:31.890629 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:31.891101 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:31.891109 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:31.892574 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:31.894016 (+ 1442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:31.894024 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:31.894026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:31.894345 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:31.894735 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:31.894736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:31.894736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:31.894878 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:31.895197 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:31.895205 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:31.895356 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 07:17:31.895485 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 07:17:31.895649 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260811 07:17:31.896564 27566 heartbeater.cc:347] Connected to a master server at 127.9.142.190:33583
I20260811 07:17:31.896682 27566 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:31.896885 27566 heartbeater.cc:511] Master 127.9.142.190:33583 requested a full tablet report, sending...
I20260811 07:17:31.897423 27275 ts_manager.cc:194] Registered new tserver with Master: 08c8d70a447f4ba5886276d474bbefd9 (127.9.142.129:45479)
I20260811 07:17:31.898106 27275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:57123
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:17:31.923014 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33583
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:32.008524 27574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:32.008719 27574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:32.008744 27574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:32.009785 27574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:32.009819 27574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:32.009845 27574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:17:32.011199 27574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:32.011377 27574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:32.011541 27574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:17:32.016577 27586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:32.016579 27583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:32.016638 27584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:32.016884 27574 server_base.cc:1034] running on GCE node
I20260811 07:17:32.017076 27574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:32.017268 27574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:32.018452 27574 hybrid_clock.cc:648] HybridClock initialized: now 1786432652018438 us; error 26 us; skew 500 ppm
Aug 11 07:17:32 dist-test-slave-7f01 krb5kdc[27198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432652, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:32.021198 27574 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:17:32.021687 27574 webserver.cc:460] Webserver started at http://127.9.142.130:42305/ using document root <none> and password file <none>
I20260811 07:17:32.021932 27574 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:32.022008 27574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:32.022162 27574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:32.023186 27574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "c078fef6f09748809c042ccfbbdde159"
format_stamp: "Formatted at 2026-08-11 07:17:32 on dist-test-slave-7f01"
server_key: "2aaecefc349b767420b72d261d36d8f1"
server_key_iv: "27115f9fde675f13757af21baced8b37"
server_key_version: "encryptionkey@0"
I20260811 07:17:32.023558 27574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "c078fef6f09748809c042ccfbbdde159"
format_stamp: "Formatted at 2026-08-11 07:17:32 on dist-test-slave-7f01"
server_key: "2aaecefc349b767420b72d261d36d8f1"
server_key_iv: "27115f9fde675f13757af21baced8b37"
server_key_version: "encryptionkey@0"
I20260811 07:17:32.025024 27574 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:32.025820 27595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:32.026010 27574 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:17:32.026116 27574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "c078fef6f09748809c042ccfbbdde159"
format_stamp: "Formatted at 2026-08-11 07:17:32 on dist-test-slave-7f01"
server_key: "2aaecefc349b767420b72d261d36d8f1"
server_key_iv: "27115f9fde675f13757af21baced8b37"
server_key_version: "encryptionkey@0"
I20260811 07:17:32.026197 27574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:32.041543 27574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:32.043534 27574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:32.043720 27574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:32.044055 27574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:32.044370 27574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:32.044430 27574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:32.044471 27574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:32.044502 27574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:32.050740 27574 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:37901
I20260811 07:17:32.050843 27773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:37901 every 8 connection(s)
I20260811 07:17:32.051239 27574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:17:32.058369 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 27574
I20260811 07:17:32.058482 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
Aug 11 07:17:32 dist-test-slave-7f01 krb5kdc[27198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432652, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:32.058718 9786 external_mini_cluster.cc:1428] Setting key 0084e4d61eb15c5e0a9d070c371cf2db
I20260811 07:17:32.062525 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.052103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:52633 (local address 127.9.142.190:33583)
0811 07:17:32.052182 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:32.052185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:32.052436 (+ 251us) server_negotiation.cc:407] Connection header received
0811 07:17:32.053284 (+ 848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:32.053287 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:32.053302 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:32.053373 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:32.054620 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.055183 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.056395 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.056633 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.056735 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.059201 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:32.059202 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:32.059203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:32.059210 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:32.060901 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:32.061429 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:32.061430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:32.061430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:32.061491 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:32.061822 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:32.061823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:32.061823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:32.061951 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:32.062034 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:32.062313 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 07:17:32.062426 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:17:32.062690 27777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.052056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33583 (local address 127.9.142.130:52633)
0811 07:17:32.052261 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:32.052323 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:32.053150 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:32.053460 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:32.053465 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:32.054244 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:32.054514 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.054519 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.055308 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.055310 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.056274 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.056277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.056748 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.056749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.056885 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.057440 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:32.057449 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:32.059116 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:32.060981 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:32.060995 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:32.060997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:32.061328 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:32.061619 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:32.061622 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:32.061622 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:32.061731 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:32.062034 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:32.062042 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:32.062173 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 07:17:32.062291 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 07:17:32.062452 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":88,"threads_started":1}
I20260811 07:17:32.063254 27774 heartbeater.cc:347] Connected to a master server at 127.9.142.190:33583
I20260811 07:17:32.063381 27774 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:32.063566 27774 heartbeater.cc:511] Master 127.9.142.190:33583 requested a full tablet report, sending...
I20260811 07:17:32.064033 27275 ts_manager.cc:194] Registered new tserver with Master: c078fef6f09748809c042ccfbbdde159 (127.9.142.130:37901)
I20260811 07:17:32.064591 27275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:52633
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:17:32.087214 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33583
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:17:32.172410 27784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:17:32.172644 27784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:17:32.172686 27784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:17:32.173810 27784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:17:32.173882 27784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:17:32.173928 27784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:17:32.175402 27784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:33583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:17:32.175679 27784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:17:32.175936 27784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:17:32.181110 27784 server_base.cc:1034] running on GCE node
W20260811 07:17:32.181082 27791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:32.181085 27793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:17:32.181077 27796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:17:32.181542 27784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:17:32.181824 27784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:17:32.182999 27784 hybrid_clock.cc:648] HybridClock initialized: now 1786432652182977 us; error 40 us; skew 500 ppm
Aug 11 07:17:32 dist-test-slave-7f01 krb5kdc[27198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432652, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:17:32.185606 27784 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:17:32.186076 27784 webserver.cc:460] Webserver started at http://127.9.142.131:32833/ using document root <none> and password file <none>
I20260811 07:17:32.186336 27784 fs_manager.cc:359] Metadata directory not provided
I20260811 07:17:32.186411 27784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:17:32.186573 27784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:17:32.187659 27784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "0a64def44c3c44fe8e26790b29e36745"
format_stamp: "Formatted at 2026-08-11 07:17:32 on dist-test-slave-7f01"
server_key: "63599dc03597e7f32b104402ccb85909"
server_key_iv: "e741c5821abceeb59fdb8bc4c6190f72"
server_key_version: "encryptionkey@0"
I20260811 07:17:32.188097 27784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "0a64def44c3c44fe8e26790b29e36745"
format_stamp: "Formatted at 2026-08-11 07:17:32 on dist-test-slave-7f01"
server_key: "63599dc03597e7f32b104402ccb85909"
server_key_iv: "e741c5821abceeb59fdb8bc4c6190f72"
server_key_version: "encryptionkey@0"
I20260811 07:17:32.189428 27784 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:17:32.190182 27805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:32.190359 27784 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:17:32.190481 27784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "0a64def44c3c44fe8e26790b29e36745"
format_stamp: "Formatted at 2026-08-11 07:17:32 on dist-test-slave-7f01"
server_key: "63599dc03597e7f32b104402ccb85909"
server_key_iv: "e741c5821abceeb59fdb8bc4c6190f72"
server_key_version: "encryptionkey@0"
I20260811 07:17:32.190562 27784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:17:32.197800 27784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:17:32.199556 27784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:17:32.199723 27784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:17:32.200017 27784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:17:32.200337 27784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:17:32.200399 27784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:32.200450 27784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:17:32.200475 27784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:17:32.209403 27784 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:42269
I20260811 07:17:32.209448 27991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:42269 every 8 connection(s)
I20260811 07:17:32.209779 27784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:17:32.212531 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 27784
I20260811 07:17:32.212623 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:17:32.212839 9786 external_mini_cluster.cc:1428] Setting key 4973b7ea1fbdcdd9013a6e28e6927323
Aug 11 07:17:32 dist-test-slave-7f01 krb5kdc[27198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432652, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:17:32.219507 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.210480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:58199 (local address 127.9.142.190:33583)
0811 07:17:32.210544 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:32.210546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:32.210735 (+ 189us) server_negotiation.cc:407] Connection header received
0811 07:17:32.211290 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:32.211291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:32.211303 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:32.211358 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:32.212379 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.213028 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.214387 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.214596 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.214660 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.216830 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:32.216831 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:32.216831 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:32.216838 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:32.218311 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:32.218685 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:32.218686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:32.218686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:32.218739 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:32.218978 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:32.218978 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:32.218979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:32.219083 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:32.219136 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:32.219376 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 07:17:32.219442 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:17:32.219660 28002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.210447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:33583 (local address 127.9.142.131:58199)
0811 07:17:32.210607 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:32.210648 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:32.211200 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:32.211408 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:32.211411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:32.212072 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:17:32.212271 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.212277 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.213160 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.213161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.214299 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.214303 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.214681 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.214682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.214781 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.215271 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:17:32.215279 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:17:32.216740 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:17:32.218392 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:32.218399 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:32.218401 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:32.218615 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:32.218803 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:17:32.218804 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:17:32.218804 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:17:32.218906 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:17:32.219143 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:17:32.219148 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:17:32.219261 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 07:17:32.219343 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:17:32.219460 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260811 07:17:32.220223 27994 heartbeater.cc:347] Connected to a master server at 127.9.142.190:33583
I20260811 07:17:32.220310 27994 heartbeater.cc:464] Registering TS with master...
I20260811 07:17:32.220520 27994 heartbeater.cc:511] Master 127.9.142.190:33583 requested a full tablet report, sending...
I20260811 07:17:32.220922 27275 ts_manager.cc:194] Registered new tserver with Master: 0a64def44c3c44fe8e26790b29e36745 (127.9.142.131:42269)
I20260811 07:17:32.221261 27275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:58199
I20260811 07:17:32.224630 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:17:32.232018 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.225954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55306 (local address 127.9.142.190:33583)
0811 07:17:32.226030 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:32.226032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:32.226142 (+ 110us) server_negotiation.cc:407] Connection header received
0811 07:17:32.226220 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:32.226221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:32.226232 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:32.226301 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:17:32.227028 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.227473 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.228222 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.228440 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.228496 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.229685 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:17:32.229686 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:17:32.229686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:17:32.229692 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:17:32.230931 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:32.231244 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:32.231245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:32.231245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:32.231296 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:17:32.231463 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:17:32.231463 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:17:32.231463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:17:32.231603 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:17:32.231683 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:32.231855 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:17:32.231913 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:17:32.233752 27275 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:17:32.235390 27275 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:17:32.242314 28019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.237724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:45479 (local address 127.0.0.1:43112)
0811 07:17:32.238160 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:32.238168 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:32.238203 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:32.239009 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:32.239010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:32.239012 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:32.239055 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.239056 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.240071 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.240072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.241054 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.241057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.242009 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.242010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.242090 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.242105 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 07:17:32.242173 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 07:17:32.242229 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":3,"thread_start_us":63,"threads_started":1}
I20260811 07:17:32.242443 28018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.237859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56682 (local address 127.9.142.130:37901)
0811 07:17:32.238622 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:32.238627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:32.238637 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:17:32.238751 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:32.238753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:32.238765 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:32.238865 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:32.239016 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.240113 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.241542 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.242089 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.242168 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.242226 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:32.242303 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 07:17:32.242352 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":92,"threads_started":1}
I20260811 07:17:32.242503 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.238144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54232 (local address 127.9.142.131:42269)
0811 07:17:32.238309 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:32.238314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:32.238325 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:17:32.238368 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:32.238369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:32.238382 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:32.238451 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:32.238649 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.239779 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.241290 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.241935 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.241997 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.242056 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:32.242358 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 07:17:32.242404 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":96,"threads_started":1}
I20260811 07:17:32.242560 28017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.237921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:42269 (local address 127.0.0.1:54232)
0811 07:17:32.238252 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:32.238258 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:32.238281 (+ 23us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:32.238504 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:32.238508 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:32.238510 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:32.238580 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.238582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.239905 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.239906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.241201 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.241205 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.242094 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.242095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.242187 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.242192 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:17:32.242244 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 07:17:32.242297 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":93,"threads_started":1}
I20260811 07:17:32.242782 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.237955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43112 (local address 127.9.142.129:45479)
0811 07:17:32.238376 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:32.238380 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:32.238388 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:32.238418 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:32.238419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:32.238461 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:32.239019 (+ 558us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:32.239110 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.239946 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.241154 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.241900 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.241996 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.242056 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:32.242650 (+ 594us) server_negotiation.cc:299] Negotiation successful
0811 07:17:32.242705 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":75,"threads_started":1}
I20260811 07:17:32.242966 28015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.237724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:37901 (local address 127.0.0.1:56682)
0811 07:17:32.237890 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:32.237930 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:32.237995 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:32.238863 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:32.238864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:32.238867 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:32.238914 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.238916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.240218 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.240219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.241446 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.241448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.242175 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.242176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.242237 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.242241 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:32.242293 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 07:17:32.242324 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":1,"thread_start_us":80,"threads_started":1}
I20260811 07:17:32.243268 27878 tablet_service.cc:1467] Processing CreateTablet for tablet 1de417c407fc47ce842e9b9e34edf379 (DEFAULT_TABLE table=test-table [id=0b9d26d1f32a4b7d9d867674f1486494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:32.243429 27465 tablet_service.cc:1467] Processing CreateTablet for tablet 1de417c407fc47ce842e9b9e34edf379 (DEFAULT_TABLE table=test-table [id=0b9d26d1f32a4b7d9d867674f1486494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:32.243636 27878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de417c407fc47ce842e9b9e34edf379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:32.243821 27465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de417c407fc47ce842e9b9e34edf379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:32.246348 28024 tablet_bootstrap.cc:492] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: Bootstrap starting.
I20260811 07:17:32.246411 28026 tablet_bootstrap.cc:492] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9: Bootstrap starting.
I20260811 07:17:32.247220 28024 tablet_bootstrap.cc:654] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:32.247110 27674 tablet_service.cc:1467] Processing CreateTablet for tablet 1de417c407fc47ce842e9b9e34edf379 (DEFAULT_TABLE table=test-table [id=0b9d26d1f32a4b7d9d867674f1486494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:17:32.247239 28026 tablet_bootstrap.cc:654] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:32.247484 27674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de417c407fc47ce842e9b9e34edf379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:17:32.247887 28024 log.cc:824] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:32.247898 28026 log.cc:824] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:32.248728 28026 tablet_bootstrap.cc:492] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9: No bootstrap required, opened a new log
I20260811 07:17:32.248812 28026 ts_tablet_manager.cc:1397] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:17:32.248855 28024 tablet_bootstrap.cc:492] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: No bootstrap required, opened a new log
I20260811 07:17:32.248932 28024 ts_tablet_manager.cc:1397] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 07:17:32.250564 28024 raft_consensus.cc:348] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } }
I20260811 07:17:32.250723 28024 raft_consensus.cc:374] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:32.250768 28024 raft_consensus.cc:729] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a64def44c3c44fe8e26790b29e36745, State: Initialized, Role: FOLLOWER
I20260811 07:17:32.250946 28024 consensus_queue.cc:260] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } }
I20260811 07:17:32.250962 28026 raft_consensus.cc:348] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } }
I20260811 07:17:32.251143 28026 raft_consensus.cc:374] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:32.251204 28026 raft_consensus.cc:729] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c8d70a447f4ba5886276d474bbefd9, State: Initialized, Role: FOLLOWER
I20260811 07:17:32.251253 28024 ts_tablet_manager.cc:1428] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 07:17:32.251037 28029 tablet_bootstrap.cc:492] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: Bootstrap starting.
I20260811 07:17:32.251343 28026 consensus_queue.cc:260] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } }
I20260811 07:17:32.251406 27994 heartbeater.cc:503] Master 127.9.142.190:33583 was elected leader, sending a full tablet report...
I20260811 07:17:32.251446 28033 raft_consensus.cc:482] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:17:32.251523 28033 raft_consensus.cc:504] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } }
I20260811 07:17:32.251626 28026 ts_tablet_manager.cc:1428] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:17:32.251767 27566 heartbeater.cc:503] Master 127.9.142.190:33583 was elected leader, sending a full tablet report...
I20260811 07:17:32.252391 28029 tablet_bootstrap.cc:654] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: Neither blocks nor log segments found. Creating new log.
I20260811 07:17:32.253181 28033 leader_election.cc:288] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08c8d70a447f4ba5886276d474bbefd9 (127.9.142.129:45479), c078fef6f09748809c042ccfbbdde159 (127.9.142.130:37901)
I20260811 07:17:32.253489 28029 log.cc:824] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: Log is configured to *not* fsync() on all Append() calls
I20260811 07:17:32.254289 28029 tablet_bootstrap.cc:492] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: No bootstrap required, opened a new log
I20260811 07:17:32.254381 28029 ts_tablet_manager.cc:1397] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:17:32.255465 28002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.252032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:45479 (local address 127.9.142.131:43833)
0811 07:17:32.252101 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:32.252114 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:32.252161 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:32.252406 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:32.252408 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:32.252409 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:32.252474 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.252475 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.253345 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.253346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.254468 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.254470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.255218 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.255219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.255301 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.255305 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:17:32.255360 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 07:17:32.255396 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 07:17:32.255483 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.252230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:43833 (local address 127.9.142.129:45479)
0811 07:17:32.252274 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:32.252276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:32.252284 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:17:32.252306 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:32.252307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:32.252316 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:32.252360 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:32.252550 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.253264 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.254557 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.255128 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.255209 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.255219 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:32.255386 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 07:17:32.255422 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:17:32.255827 27482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de417c407fc47ce842e9b9e34edf379" candidate_uuid: "0a64def44c3c44fe8e26790b29e36745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c8d70a447f4ba5886276d474bbefd9" is_pre_election: true
I20260811 07:17:32.255971 27482 raft_consensus.cc:2454] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a64def44c3c44fe8e26790b29e36745 in term 0.
I20260811 07:17:32.256042 28035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.252791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:37901 (local address 127.9.142.131:43617)
0811 07:17:32.252933 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:32.252943 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:17:32.253020 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:17:32.253173 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:17:32.253174 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:17:32.253175 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:17:32.253233 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.253234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.254078 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.254079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.254968 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:17:32.254970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.255778 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.255779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:17:32.255850 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.255855 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:17:32.255916 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 07:17:32.255954 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260811 07:17:32.256049 28018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.252834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:43617 (local address 127.9.142.130:37901)
0811 07:17:32.252875 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:32.252877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:32.252996 (+ 119us) server_negotiation.cc:407] Connection header received
0811 07:17:32.253085 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:32.253085 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:32.253093 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:32.253121 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:17:32.253301 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.253980 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.255072 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.255649 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.255712 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.255721 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:32.255940 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 07:17:32.255987 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:17:32.256349 27807 leader_election.cc:302] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c8d70a447f4ba5886276d474bbefd9, 0a64def44c3c44fe8e26790b29e36745; no voters:
I20260811 07:17:32.256376 27700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de417c407fc47ce842e9b9e34edf379" candidate_uuid: "0a64def44c3c44fe8e26790b29e36745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c078fef6f09748809c042ccfbbdde159" is_pre_election: true
I20260811 07:17:32.256505 28030 raft_consensus.cc:2781] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:17:32.256562 28030 raft_consensus.cc:482] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:17:32.256590 28030 raft_consensus.cc:3037] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:32.256546 28029 raft_consensus.cc:348] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } }
I20260811 07:17:32.256686 28029 raft_consensus.cc:374] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:17:32.256723 28029 raft_consensus.cc:729] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c078fef6f09748809c042ccfbbdde159, State: Initialized, Role: FOLLOWER
W20260811 07:17:32.256754 27809 leader_election.cc:341] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c078fef6f09748809c042ccfbbdde159 (127.9.142.130:37901): Illegal state: must be running to vote when last-logged opid is not known
I20260811 07:17:32.256837 28029 consensus_queue.cc:260] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } }
I20260811 07:17:32.257112 27774 heartbeater.cc:503] Master 127.9.142.190:33583 was elected leader, sending a full tablet report...
I20260811 07:17:32.257130 28029 ts_tablet_manager.cc:1428] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:17:32.257498 28030 raft_consensus.cc:504] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } }
I20260811 07:17:32.257676 28030 leader_election.cc:288] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [CANDIDATE]: Term 1 election: Requested vote from peers 08c8d70a447f4ba5886276d474bbefd9 (127.9.142.129:45479), c078fef6f09748809c042ccfbbdde159 (127.9.142.130:37901)
I20260811 07:17:32.257799 27482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de417c407fc47ce842e9b9e34edf379" candidate_uuid: "0a64def44c3c44fe8e26790b29e36745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c8d70a447f4ba5886276d474bbefd9"
I20260811 07:17:32.257843 27700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de417c407fc47ce842e9b9e34edf379" candidate_uuid: "0a64def44c3c44fe8e26790b29e36745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c078fef6f09748809c042ccfbbdde159"
I20260811 07:17:32.257896 27482 raft_consensus.cc:3037] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:32.257929 27700 raft_consensus.cc:3037] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:17:32.258589 27700 raft_consensus.cc:2454] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a64def44c3c44fe8e26790b29e36745 in term 1.
I20260811 07:17:32.258716 27482 raft_consensus.cc:2454] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a64def44c3c44fe8e26790b29e36745 in term 1.
I20260811 07:17:32.258760 27809 leader_election.cc:302] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a64def44c3c44fe8e26790b29e36745, c078fef6f09748809c042ccfbbdde159; no voters:
I20260811 07:17:32.258872 28030 raft_consensus.cc:2781] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:17:32.258958 28030 raft_consensus.cc:686] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 1 LEADER]: Becoming Leader. State: Replica: 0a64def44c3c44fe8e26790b29e36745, State: Running, Role: LEADER
I20260811 07:17:32.259061 28030 consensus_queue.cc:237] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } }
I20260811 07:17:32.259893 27273 catalog_manager.cc:5495] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a64def44c3c44fe8e26790b29e36745 (127.9.142.131). New cstate: current_term: 1 leader_uuid: "0a64def44c3c44fe8e26790b29e36745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a64def44c3c44fe8e26790b29e36745" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 } health_report { overall_health: UNKNOWN } } }
I20260811 07:17:32.266592 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.264469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54238 (local address 127.9.142.131:42269)
0811 07:17:32.264530 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 07:17:32.264532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:17:32.264543 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:17:32.264598 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:17:32.264599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:17:32.264614 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:17:32.264698 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:17:32.264820 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.265251 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.265984 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:17:32.266162 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:17:32.266215 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:17:32.266356 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:17:32.266442 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:17:32.266500 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:17:32.266511 (+ 11us) server_negotiation.cc:299] Negotiation successful
0811 07:17:32.266526 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:17:32.268399 27482 raft_consensus.cc:1261] T 1de417c407fc47ce842e9b9e34edf379 P 08c8d70a447f4ba5886276d474bbefd9 [term 1 FOLLOWER]: Refusing update from remote peer 0a64def44c3c44fe8e26790b29e36745: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:32.268428 27700 raft_consensus.cc:1261] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159 [term 1 FOLLOWER]: Refusing update from remote peer 0a64def44c3c44fe8e26790b29e36745: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:17:32.268791 28033 consensus_queue.cc:1035] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c078fef6f09748809c042ccfbbdde159" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 37901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:32.268929 28030 consensus_queue.cc:1035] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08c8d70a447f4ba5886276d474bbefd9" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:17:32.271227 28043 mvcc.cc:205] Tried to move back new op lower bound from 7317228143688486912 to 7317228143653842944. Current Snapshot: MvccSnapshot[applied={T|T < 7317228143688486912}]
I20260811 07:17:32.273648 27275 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:32.273752 27275 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:17:32.274524 27275 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afd0221fc8cb45a6b29cf491f44f149b: Sending DeleteTablet for 3 replicas of tablet 1de417c407fc47ce842e9b9e34edf379
I20260811 07:17:32.274860 27465 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de417c407fc47ce842e9b9e34edf379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:32 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:43112
I20260811 07:17:32.274887 27674 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de417c407fc47ce842e9b9e34edf379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:32 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:56682
I20260811 07:17:32.274894 27878 tablet_service.cc:1514] Processing DeleteTablet for tablet 1de417c407fc47ce842e9b9e34edf379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:17:32 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:54232
I20260811 07:17:32.275265 28064 tablet_replica.cc:330] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: stopping tablet replica
I20260811 07:17:32.275318 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 27369
I20260811 07:17:32.275381 28064 raft_consensus.cc:2229] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:17:32.282054 28064 raft_consensus.cc:2258] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:32.284053 28064 ts_tablet_manager.cc:1905] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:32.285745 28064 ts_tablet_manager.cc:1918] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:32.285823 28064 log.cc:1196] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/1de417c407fc47ce842e9b9e34edf379
I20260811 07:17:32.286101 28064 ts_tablet_manager.cc:1939] T 1de417c407fc47ce842e9b9e34edf379 P 0a64def44c3c44fe8e26790b29e36745: Deleting consensus metadata
I20260811 07:17:32.286540 27254 catalog_manager.cc:4841] TS 0a64def44c3c44fe8e26790b29e36745 (127.9.142.131:42269): tablet 1de417c407fc47ce842e9b9e34edf379 (table test-table [id=0b9d26d1f32a4b7d9d867674f1486494]) successfully deleted
I20260811 07:17:32.288041 28062 tablet_replica.cc:330] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: stopping tablet replica
I20260811 07:17:32.288219 28062 raft_consensus.cc:2229] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:17:32.288393 28062 raft_consensus.cc:2258] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:17:32.288858 28062 ts_tablet_manager.cc:1905] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:17:32.290267 28062 ts_tablet_manager.cc:1918] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:17:32.290380 28062 log.cc:1196] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/1de417c407fc47ce842e9b9e34edf379
I20260811 07:17:32.290648 28062 ts_tablet_manager.cc:1939] T 1de417c407fc47ce842e9b9e34edf379 P c078fef6f09748809c042ccfbbdde159: Deleting consensus metadata
I20260811 07:17:32.291112 27257 catalog_manager.cc:4841] TS c078fef6f09748809c042ccfbbdde159 (127.9.142.130:37901): tablet 1de417c407fc47ce842e9b9e34edf379 (table test-table [id=0b9d26d1f32a4b7d9d867674f1486494]) successfully deleted
W20260811 07:17:32.293892 27254 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:45479 (error 108)
I20260811 07:17:32.294116 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 27574
I20260811 07:17:32.326109 28015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:17:32.325878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:45479 (local address 127.0.0.1:43118)
0811 07:17:32.325973 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 07:17:32.326047 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:45479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 07:17:32.326476 27254 catalog_manager.cc:4584] TS 08c8d70a447f4ba5886276d474bbefd9 (127.9.142.129:45479): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1de417c407fc47ce842e9b9e34edf379: Network error: Client connection negotiation failed: client connection to 127.9.142.129:45479: connect: Connection refused (error 111)
I20260811 07:17:32.331801 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 27784
I20260811 07:17:32.345808 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 27226
2026-08-11T07:17:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2190 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:17:32 dist-test-slave-7f01 krb5kdc[28068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:17:32 dist-test-slave-7f01 krb5kdc[28068](info): set up 2 sockets
Aug 11 07:17:32 dist-test-slave-7f01 krb5kdc[28068](info): commencing operation
krb5kdc: starting...
W20260811 07:17:33.651983 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:17:33 dist-test-slave-7f01 krb5kdc[28068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:17:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:17:33Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.142.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.142.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/rangeradmin_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/rangeradmin_127.9.142.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.142.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.142.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/rangerlookup_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/rangerlookup_127.9.142.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.142.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.142.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/HTTP_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/HTTP_127.9.142.148@KRBTEST.COM.keytab.
I20260811 07:17:33.852216 9786 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNunSB7/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/postgres -l logfile start
2026-08-11 07:17:36.617 UTC [28124] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 07:17:36.617 UTC [28124] LOG: listening on IPv4 address "127.9.142.148", port 51565
2026-08-11 07:17:36.621 UTC [28124] LOG: listening on Unix socket "/tmp/.s.PGSQL.51565"
2026-08-11 07:17:36.662 UTC [28127] LOG: database system was shut down at 2026-08-11 07:17:35 UTC
2026-08-11 07:17:36.667 UTC [28124] LOG: database system is ready to accept connections
I20260811 07:17:37.889516 9786 mini_postgres.cc:96] Postgres bound to 51565
2026-08-11 07:17:37.897 UTC [28136] FATAL: database "slave" does not exist
127.9.142.148:51565 - accepting connections
I20260811 07:17:37.898850 9786 mini_ranger.cc:161] Starting Ranger...
I20260811 07:17:37.915802 9786 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 07:17:38.434340 9786 mini_ranger.cc:87] Created ranger Postgres database
I20260811 07:17:38.434559 9786 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-admin
2026-08-11 07:17:38,822 [I] DB FLAVOR :POSTGRES
2026-08-11 07:17:38,822 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:17:38,822 [I] Checking connection..
2026-08-11 07:17:38,823 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 07:17:39,112 [I] Checking connection passed.
2026-08-11 07:17:39,112 [I] --------- Verifying version history table ---------
2026-08-11 07:17:39,112 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:17:39,370 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:17:39,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:17:39,629 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:17:39,630 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 07:17:39,630 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 07:17:39.877 UTC [28239] WARNING: there is no transaction in progress
2026-08-11 07:17:39,892 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 07:17:39,892 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:17:40,184 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 07:17:40,184 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:17:40,185 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 07:17:40,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 07:17:40,698 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7f01.c.gcp-upstream.internal','N') ;"
2026-08-11 07:17:40,966 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:17:41,232 [I] Table x_portal_user does not exist in database ranger
2026-08-11 07:17:41,232 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:17:41,505 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 07:17:41,505 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:17:41,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:17:42,055 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 07:17:42,056 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 07:17:43.063 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.080 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.095 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.112 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.129 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.147 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.205 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.212 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.229 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.240 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.251 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.266 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.276 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.283 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.292 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:43.301 UTC [28412] WARNING: there is no transaction in progress
2026-08-11 07:17:44,013 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 07:17:44,013 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 07:17:44,284 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 07:17:44,285 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:17:44,571 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 07:17:44,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:17:44,846 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 07:17:44,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:17:45,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:17:45,399 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7f01.c.gcp-upstream.internal';"
2026-08-11 07:17:45,648 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 07:17:45,648 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 07:17:45,891 [I] DB_PATCHES have already been applied
I20260811 07:17:45.899159 9786 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNunSB7/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 07:17:45.899237 9786 mini_ranger.cc:193] Using host: 127.9.142.148
I20260811 07:17:45.903697 9786 mini_ranger.cc:227] Ranger admin URL: http://127.9.142.148:59085
Aug 11, 2026 7:17:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:17:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:17:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 7:17:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 7:17:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 7:17:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 7:17:46 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 07:17:47.413659 9786 mini_ranger.cc:160] Time spent starting Ranger: real 9.515s user 0.000s sys 0.012s
Aug 11, 2026 7:18:09 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 7:18:09 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 7:18:09 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 7:18:09 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 7:18:10 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 07:18:10.873598 9786 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.142.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.142.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/rangerkms_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/rangerkms_127.9.142.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.142.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.142.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.142.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/HTTP_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.142.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/HTTP_127.9.142.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 07:18:10 dist-test-slave-7f01 krb5kdc[28068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432690, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 07:18:10.974532 9786 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 07:18:10.985814 9786 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 07:18:11.916603 9786 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 07:18:11.916706 9786 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-kms
I20260811 07:18:11.916728 9786 mini_ranger_kms.cc:227] Using postgres at 127.9.142.148:51565
2026-08-11 07:18:12,139 [I] DB FLAVOR :POSTGRES
2026-08-11 07:18:12,139 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:18:12,139 [I] Checking connection
2026-08-11 07:18:12,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 07:18:12,423 [I] connection success
2026-08-11 07:18:12,424 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 07:18:12,424 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 07:18:12,424 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 07:18:12,719 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 07:18:12,720 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:18:12,720 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 07:18:12,720 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:51565/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 07:18:13,024 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 07:18:13.507191 9786 mini_ranger_kms.cc:310] Created kms service
I20260811 07:18:13.687326 9786 mini_ranger_kms.cc:326] Created kudu user
I20260811 07:18:13.735594 9786 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 07:18:13 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432690, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:18:14.209594 9786 mini_ranger_kms.cc:384] Added ranger policy
I20260811 07:18:14.209726 9786 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 07:18:14.209753 9786 mini_ranger_kms.cc:240] Using host: 127.9.142.148
I20260811 07:18:14.215201 9786 mini_ranger_kms.cc:276] Ranger KMS PID: 28716
I20260811 07:18:14.215358 9786 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.142.148:42559
Aug 11, 2026 7:18:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:18:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:18:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 7:18:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 7:18:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 7:18:15 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 07:18:16 dist-test-slave-7f01 krb5kdc[28068](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786432696, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.142.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 07:18:17 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432696, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.142.148@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:18:17.159713 9786 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.185s user 0.000s sys 0.207s
I20260811 07:18:17.159862 9786 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 07:18:17.159952 9786 mini_ranger_kms.cc:401] 127.9.142.148:42559/kms/v1/keys
Aug 11 07:18:17 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432696, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.142.148@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
Aug 11 07:18:19 dist-test-slave-7f01 krb5kdc[28068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:18:19.867203 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:42141
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:34213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:42141
--ranger_config_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:42559/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:18:19.959265 28794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:18:19.959525 28794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:18:19.959563 28794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:18:19.960722 28794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:18:19.960798 28794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:18:19.960824 28794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:18:19.960857 28794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:18:19.960886 28794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:18:19.962517 28794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.142.148:42559/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:42141
--ranger_config_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:42141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:18:19.962790 28794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:18:19.963017 28794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:18:19.967684 28804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:18:19.967697 28802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:18:19.967798 28807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:18:19.967970 28794 server_base.cc:1034] running on GCE node
I20260811 07:18:19.968261 28794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:18:19.968521 28794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:18:19.969684 28794 hybrid_clock.cc:648] HybridClock initialized: now 1786432699969671 us; error 25 us; skew 500 ppm
Aug 11 07:18:19 dist-test-slave-7f01 krb5kdc[28068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432699, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:18:19.974785 28794 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:18:19.975286 28794 webserver.cc:460] Webserver started at http://127.9.142.190:45637/ using document root <none> and password file <none>
I20260811 07:18:19.975522 28794 fs_manager.cc:359] Metadata directory not provided
I20260811 07:18:19.975582 28794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:18:19.975785 28794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:18:19 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432699, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:18:20.039389 28794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "9fa97cccaad84efba50ac24327f69786"
format_stamp: "Formatted at 2026-08-11 07:18:20 on dist-test-slave-7f01"
server_key: "c437bd6f95026c5861f943c2d9aaba64"
server_key_iv: "e2d53510d7da8a927d8a97a1e342e7ed"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:20.039858 28794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "9fa97cccaad84efba50ac24327f69786"
format_stamp: "Formatted at 2026-08-11 07:18:20 on dist-test-slave-7f01"
server_key: "c437bd6f95026c5861f943c2d9aaba64"
server_key_iv: "e2d53510d7da8a927d8a97a1e342e7ed"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:20.041437 28794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:18:20.055712 28818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:20.056010 28794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:18:20.056141 28794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "9fa97cccaad84efba50ac24327f69786"
format_stamp: "Formatted at 2026-08-11 07:18:20 on dist-test-slave-7f01"
server_key: "c437bd6f95026c5861f943c2d9aaba64"
server_key_iv: "e2d53510d7da8a927d8a97a1e342e7ed"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:20.056249 28794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:18:20.073580 28794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:18:20.075793 28794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:18:20.075951 28794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:18:20.081279 28794 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:42141
I20260811 07:18:20.081344 28897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:42141 every 8 connection(s)
I20260811 07:18:20.081733 28794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:18:20.082573 28898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:18:20.084185 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 28794
I20260811 07:18:20.084311 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:18:20.084548 9786 external_mini_cluster.cc:1428] Setting key ee1d9745bf2846724bd369e8f380904e
I20260811 07:18:20.085803 28898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786: Bootstrap starting.
I20260811 07:18:20.086670 28898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786: Neither blocks nor log segments found. Creating new log.
I20260811 07:18:20.087041 28898 log.cc:824] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786: Log is configured to *not* fsync() on all Append() calls
I20260811 07:18:20.087862 28898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786: No bootstrap required, opened a new log
I20260811 07:18:20.090096 28898 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa97cccaad84efba50ac24327f69786" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42141 } }
I20260811 07:18:20.090272 28898 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:18:20.090322 28898 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa97cccaad84efba50ac24327f69786, State: Initialized, Role: FOLLOWER
I20260811 07:18:20.090453 28898 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa97cccaad84efba50ac24327f69786" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42141 } }
I20260811 07:18:20.090549 28898 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:18:20.090581 28898 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:18:20.090628 28898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:18:20.091318 28898 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa97cccaad84efba50ac24327f69786" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42141 } }
I20260811 07:18:20.091457 28898 leader_election.cc:302] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fa97cccaad84efba50ac24327f69786; no voters:
I20260811 07:18:20.091687 28898 leader_election.cc:288] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:18:20.091714 28905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:18:20.092020 28905 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa97cccaad84efba50ac24327f69786, State: Running, Role: LEADER
I20260811 07:18:20.092195 28898 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 07:18:20 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:18:20.092165 28905 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa97cccaad84efba50ac24327f69786" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42141 } }
I20260811 07:18:20.094080 28908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fa97cccaad84efba50ac24327f69786. Latest consensus state: current_term: 1 leader_uuid: "9fa97cccaad84efba50ac24327f69786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa97cccaad84efba50ac24327f69786" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42141 } } }
I20260811 07:18:20.094245 28908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [sys.catalog]: This master's current role is: LEADER
I20260811 07:18:20.094615 28898 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:18:20.097244 28907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fa97cccaad84efba50ac24327f69786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fa97cccaad84efba50ac24327f69786" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42141 } } }
I20260811 07:18:20.097540 28907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786 [sys.catalog]: This master's current role is: LEADER
I20260811 07:18:20.100504 28903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:20.085084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40232 (local address 127.9.142.190:42141)
0811 07:18:20.085376 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:20.085395 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:20.085583 (+ 188us) server_negotiation.cc:407] Connection header received
0811 07:18:20.086249 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:20.086257 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:20.086305 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:20.086452 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:18:20.087232 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:20.088524 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:20.089652 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:20.090269 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:20.090387 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:20.093452 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:18:20.093456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:18:20.093456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:18:20.093470 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:18:20.098069 (+ 4599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:20.098606 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:20.098610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:20.098610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:20.098784 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:20.099048 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:20.099049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:20.099049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:20.099613 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:18:20.099879 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:20.100012 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 07:18:20.100283 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":94,"threads_started":1}
I20260811 07:18:20.103943 28926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:18:20.104543 28926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:18:20.108296 28926 catalog_manager.cc:1347] Generated new cluster ID: 705e76e724c549ff914b08af7284d8c5
I20260811 07:18:20.108423 28926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:18:20.114643 28926 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:18:20.115485 28926 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:18:20.124637 28926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786: Generated new TSK 0
I20260811 07:18:20.124838 28926 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:18:20.871987 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:42559/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42141
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:34213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:18:20.985888 28970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:18:20.986140 28970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:18:20.986181 28970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:18:20.987408 28970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:18:20.987490 28970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:18:20.987540 28970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:18:20.989204 28970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.142.148:42559/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:18:20.989499 28970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:18:20.989755 28970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:18:20.996990 28978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:18:20.996999 28979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:18:20.996999 28981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:18:20.997995 28970 server_base.cc:1034] running on GCE node
I20260811 07:18:20.998235 28970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:18:20.998803 28970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:18:21.000057 28970 hybrid_clock.cc:648] HybridClock initialized: now 1786432701000034 us; error 61 us; skew 500 ppm
Aug 11 07:18:20 dist-test-slave-7f01 krb5kdc[28068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432700, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:18:21.003561 28970 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:18:21.004204 28970 webserver.cc:460] Webserver started at http://127.9.142.129:35147/ using document root <none> and password file <none>
I20260811 07:18:21.004492 28970 fs_manager.cc:359] Metadata directory not provided
I20260811 07:18:21.004558 28970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:18:21.004750 28970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432700, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:18:21.021626 28970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "25ff91a2a54346f58668612ebc13d57c"
format_stamp: "Formatted at 2026-08-11 07:18:21 on dist-test-slave-7f01"
server_key: "4c52a632dfc28a3e4592723465f1e1e0"
server_key_iv: "1c9bec9b53afdd2716d7856c90c276a6"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:21.022374 28970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "25ff91a2a54346f58668612ebc13d57c"
format_stamp: "Formatted at 2026-08-11 07:18:21 on dist-test-slave-7f01"
server_key: "4c52a632dfc28a3e4592723465f1e1e0"
server_key_iv: "1c9bec9b53afdd2716d7856c90c276a6"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:21.024271 28970 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 07:18:21.043932 28994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:21.044195 28970 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:18:21.044389 28970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "25ff91a2a54346f58668612ebc13d57c"
format_stamp: "Formatted at 2026-08-11 07:18:21 on dist-test-slave-7f01"
server_key: "4c52a632dfc28a3e4592723465f1e1e0"
server_key_iv: "1c9bec9b53afdd2716d7856c90c276a6"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:21.044595 28970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:18:21.074903 28970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:18:21.077538 28970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:18:21.077705 28970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:18:21.077986 28970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:18:21.078414 28970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:18:21.078469 28970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:21.078503 28970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:18:21.078559 28970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:21.086599 28970 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:34309
I20260811 07:18:21.087134 28970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:18:21.088790 29177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:34309 every 8 connection(s)
I20260811 07:18:21.090950 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 28970
I20260811 07:18:21.091055 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:18:21.091296 9786 external_mini_cluster.cc:1428] Setting key 66788c18f5e8a0146fb8581e4fdbcbca
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432700, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
I20260811 07:18:21.129199 29180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.089690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42141 (local address 127.9.142.129:34421)
0811 07:18:21.103883 (+ 14193us) negotiation.cc:107] Waiting for socket to connect
0811 07:18:21.103965 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0811 07:18:21.104704 (+ 739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:18:21.107911 (+ 3207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:18:21.107917 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:18:21.108226 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:18:21.108540 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.108547 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.109644 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.109645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.110933 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.110936 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.116985 (+ 6049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.116997 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.117171 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.117857 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:18:21.117869 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:18:21.125202 (+ 7333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:18:21.127392 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:18:21.127401 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:18:21.127404 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:18:21.127724 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:18:21.127976 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:18:21.127976 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:18:21.127977 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:18:21.128136 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:18:21.128461 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:18:21.128468 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:18:21.128645 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 07:18:21.128750 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:18:21.128923 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14120,"thread_start_us":119,"threads_started":1}
I20260811 07:18:21.130132 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.090019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:34421 (local address 127.9.142.190:42141)
0811 07:18:21.104925 (+ 14906us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.104927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.104935 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:18:21.104962 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.104963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.104977 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.105067 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:18:21.108672 (+ 3605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.109522 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.111051 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.111382 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.111444 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.125344 (+ 13900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:18:21.125347 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:18:21.125347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:18:21.125356 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:18:21.127286 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:21.127841 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:21.127842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:21.127842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:21.127911 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:21.128219 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:21.128220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:21.128220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:21.128375 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:18:21.128433 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.129895 (+ 1462us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.130016 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14869,"thread_start_us":81,"threads_started":1}
I20260811 07:18:21.130803 29178 heartbeater.cc:347] Connected to a master server at 127.9.142.190:42141
I20260811 07:18:21.130962 29178 heartbeater.cc:464] Registering TS with master...
I20260811 07:18:21.131191 29178 heartbeater.cc:511] Master 127.9.142.190:42141 requested a full tablet report, sending...
I20260811 07:18:21.131906 28844 ts_manager.cc:194] Registered new tserver with Master: 25ff91a2a54346f58668612ebc13d57c (127.9.142.129:34309)
I20260811 07:18:21.132899 28844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:34421
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:18:21.165402 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:42559/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42141
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:34213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786432701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 07:18:21.290992 29187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:18:21.291281 29187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:18:21.291333 29187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:18:21.293115 29187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:18:21.293236 29187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:18:21.293344 29187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:18:21.295666 29187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.142.148:42559/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:18:21.295960 29187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:18:21.296271 29187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:18:21.302723 29199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:18:21.302747 29204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:18:21.303382 29187 server_base.cc:1034] running on GCE node
W20260811 07:18:21.303458 29198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:18:21.303721 29187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:18:21.304057 29187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:18:21.305246 29187 hybrid_clock.cc:648] HybridClock initialized: now 1786432701305210 us; error 48 us; skew 500 ppm
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:18:21.308255 29187 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:18:21.308825 29187 webserver.cc:460] Webserver started at http://127.9.142.130:34869/ using document root <none> and password file <none>
I20260811 07:18:21.309134 29187 fs_manager.cc:359] Metadata directory not provided
I20260811 07:18:21.309204 29187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:18:21.309406 29187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:18:21.326022 29187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14"
format_stamp: "Formatted at 2026-08-11 07:18:21 on dist-test-slave-7f01"
server_key: "1e76cb16082348a8ba85840215acf2a6"
server_key_iv: "f8a81d4aababcc8010d808865a6d0335"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:21.326484 29187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14"
format_stamp: "Formatted at 2026-08-11 07:18:21 on dist-test-slave-7f01"
server_key: "1e76cb16082348a8ba85840215acf2a6"
server_key_iv: "f8a81d4aababcc8010d808865a6d0335"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:21.332396 29187 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.002s
I20260811 07:18:21.344960 29216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:21.345512 29187 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:18:21.345621 29187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14"
format_stamp: "Formatted at 2026-08-11 07:18:21 on dist-test-slave-7f01"
server_key: "1e76cb16082348a8ba85840215acf2a6"
server_key_iv: "f8a81d4aababcc8010d808865a6d0335"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:21.345727 29187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:18:21.365440 29187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:18:21.367694 29187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:18:21.367902 29187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:18:21.368170 29187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:18:21.368556 29187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:18:21.368613 29187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:21.368655 29187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:18:21.368682 29187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:21.376572 29187 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:40087
I20260811 07:18:21.376654 29411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:40087 every 8 connection(s)
I20260811 07:18:21.376962 29187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:18:21.386080 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 29187
I20260811 07:18:21.386207 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:18:21.386459 9786 external_mini_cluster.cc:1428] Setting key 345ce13c2209628290afae283f86d88c
I20260811 07:18:21.387663 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.377854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:35551 (local address 127.9.142.190:42141)
0811 07:18:21.377906 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.377908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.378139 (+ 231us) server_negotiation.cc:407] Connection header received
0811 07:18:21.378694 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.378695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.378715 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.378764 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:18:21.379342 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.379967 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.380977 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.381188 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.381269 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.383690 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:18:21.383692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:18:21.383692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:18:21.383701 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:18:21.385619 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:21.386418 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:21.386420 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:21.386420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:21.386493 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:21.386832 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:21.386833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:21.386834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:21.386962 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:18:21.387049 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.387412 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.387527 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:18:21.388327 29414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.377857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42141 (local address 127.9.142.130:35551)
0811 07:18:21.378016 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 07:18:21.378057 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:18:21.378570 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:18:21.378834 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:18:21.378838 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:18:21.379035 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:18:21.379227 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.379231 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.380068 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.380069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.380866 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.380868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.381278 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.381279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.381416 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.381965 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:18:21.381975 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:18:21.383571 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:18:21.385727 (+ 2156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:18:21.385734 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:18:21.385737 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:18:21.386314 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:18:21.386587 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:18:21.386588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:18:21.386589 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:18:21.386722 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:18:21.387040 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:18:21.387047 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:18:21.387242 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 07:18:21.387845 (+ 603us) client_negotiation.cc:240] Negotiation successful
0811 07:18:21.388032 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260811 07:18:21.389868 29412 heartbeater.cc:347] Connected to a master server at 127.9.142.190:42141
I20260811 07:18:21.389987 29412 heartbeater.cc:464] Registering TS with master...
I20260811 07:18:21.390200 29412 heartbeater.cc:511] Master 127.9.142.190:42141 requested a full tablet report, sending...
I20260811 07:18:21.390651 28844 ts_manager.cc:194] Registered new tserver with Master: d0fcc9e1bf834ac5a2a89b61a0757c14 (127.9.142.130:40087)
I20260811 07:18:21.391228 28844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:35551
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:18:21.435247 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:42559/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42141
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:34213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:18:21.549728 29419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:18:21.550076 29419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:18:21.550132 29419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:18:21.551841 29419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:18:21.551931 29419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:18:21.551992 29419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:18:21.554131 29419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.142.148:42559/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:42141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:18:21.554374 29419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:18:21.554674 29419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:18:21.561123 29427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:18:21.561189 29431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:18:21.561415 29426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:18:21.562412 29419 server_base.cc:1034] running on GCE node
I20260811 07:18:21.562638 29419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:18:21.562944 29419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:18:21.564109 29419 hybrid_clock.cc:648] HybridClock initialized: now 1786432701564096 us; error 28 us; skew 500 ppm
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:18:21.567077 29419 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:18:21.567621 29419 webserver.cc:460] Webserver started at http://127.9.142.131:37495/ using document root <none> and password file <none>
I20260811 07:18:21.567950 29419 fs_manager.cc:359] Metadata directory not provided
I20260811 07:18:21.568068 29419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:18:21.568224 29419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:18:21.580507 29419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "e1212913680547048add9aef9dc279b5"
format_stamp: "Formatted at 2026-08-11 07:18:21 on dist-test-slave-7f01"
server_key: "ad28e213d046f786b585de9bbe84dde2"
server_key_iv: "157b3b57557074e1ab4fddb88ef1d19b"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:21.581146 29419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "e1212913680547048add9aef9dc279b5"
format_stamp: "Formatted at 2026-08-11 07:18:21 on dist-test-slave-7f01"
server_key: "ad28e213d046f786b585de9bbe84dde2"
server_key_iv: "157b3b57557074e1ab4fddb88ef1d19b"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:21.588253 29419 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s
I20260811 07:18:21.607440 29447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:21.607693 29419 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260811 07:18:21.607831 29419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "e1212913680547048add9aef9dc279b5"
format_stamp: "Formatted at 2026-08-11 07:18:21 on dist-test-slave-7f01"
server_key: "ad28e213d046f786b585de9bbe84dde2"
server_key_iv: "157b3b57557074e1ab4fddb88ef1d19b"
server_key_version: "kuduclusterkey@0"
I20260811 07:18:21.607933 29419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:18:21.664098 29419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:18:21.666373 29419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:18:21.666556 29419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:18:21.666851 29419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:18:21.667296 29419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:18:21.667356 29419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:21.667438 29419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:18:21.667469 29419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:18:21.677726 29419 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:36751
I20260811 07:18:21.678122 29419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:18:21.678757 29629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:36751 every 8 connection(s)
I20260811 07:18:21.684420 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 29419
I20260811 07:18:21.684855 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:18:21.685065 9786 external_mini_cluster.cc:1428] Setting key 8702c839fa6cddac9faff4b194aef7c8
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:18:21.699055 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.679451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:51091 (local address 127.9.142.190:42141)
0811 07:18:21.679499 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.679501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.679512 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:18:21.680149 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.680150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.680164 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.680223 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:18:21.681023 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.681662 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.683561 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.683922 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.683967 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.694987 (+ 11020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:18:21.694989 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:18:21.694990 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:18:21.694999 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:18:21.697000 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:21.697536 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:21.697538 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:21.697538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:21.697600 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:21.698085 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:21.698086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:21.698087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:21.698242 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:18:21.698289 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.698698 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.698792 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:18:21.700073 29633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.679077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42141 (local address 127.9.142.131:51091)
0811 07:18:21.679305 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 07:18:21.679350 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:18:21.680028 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:18:21.680293 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:18:21.680305 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:18:21.680536 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:18:21.680850 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.680857 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.681768 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.681769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.683450 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.683454 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.684063 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.684064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.684225 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.692237 (+ 8012us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:18:21.692250 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:18:21.694215 (+ 1965us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:18:21.697090 (+ 2875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:18:21.697098 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:18:21.697101 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:18:21.697441 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:18:21.697673 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:18:21.697674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:18:21.697674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:18:21.697820 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:18:21.698341 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:18:21.698349 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:18:21.698527 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 07:18:21.699427 (+ 900us) client_negotiation.cc:240] Negotiation successful
0811 07:18:21.699612 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":128,"threads_started":1}
I20260811 07:18:21.701162 29630 heartbeater.cc:347] Connected to a master server at 127.9.142.190:42141
I20260811 07:18:21.701301 29630 heartbeater.cc:464] Registering TS with master...
I20260811 07:18:21.701514 29630 heartbeater.cc:511] Master 127.9.142.190:42141 requested a full tablet report, sending...
I20260811 07:18:21.701930 28844 ts_manager.cc:194] Registered new tserver with Master: e1212913680547048add9aef9dc279b5 (127.9.142.131:36751)
I20260811 07:18:21.702445 28844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:51091
I20260811 07:18:21.707594 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:18:21 dist-test-slave-7f01 krb5kdc[28068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:18:21.723475 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.709293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40236 (local address 127.9.142.190:42141)
0811 07:18:21.709335 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.709337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.709644 (+ 307us) server_negotiation.cc:407] Connection header received
0811 07:18:21.709740 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.709741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.709751 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.709779 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:18:21.710621 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.711429 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.718168 (+ 6739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.718461 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.718512 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.720316 (+ 1804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:18:21.720318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:18:21.720318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:18:21.720327 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:18:21.722127 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:21.722552 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:21.722554 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:21.722554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:21.722618 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:18:21.722833 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:18:21.722834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:18:21.722834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:18:21.722981 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:18:21.723058 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.723287 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.723375 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:18:21.725910 28844 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:18:21.727963 28844 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:18:21.747988 29650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.736010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:34309 (local address 127.0.0.1:57100)
0811 07:18:21.743188 (+ 7178us) negotiation.cc:107] Waiting for socket to connect
0811 07:18:21.743202 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:18:21.743275 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:18:21.743585 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:18:21.743589 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:18:21.743592 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:18:21.743674 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.743675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.745197 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.745198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.746579 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.746582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.747641 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.747642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.747731 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.747765 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:18:21.747831 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 07:18:21.747884 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7151,"thread_start_us":76,"threads_started":1}
I20260811 07:18:21.748459 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.736124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57100 (local address 127.9.142.129:34309)
0811 07:18:21.736273 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.736278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.743298 (+ 7020us) server_negotiation.cc:407] Connection header received
0811 07:18:21.743353 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.743356 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.743377 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.743474 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:18:21.743781 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.745102 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.746688 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.747467 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.747515 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.747577 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.748322 (+ 745us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.748368 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
I20260811 07:18:21.749460 29085 tablet_service.cc:1467] Processing CreateTablet for tablet 6e35af115d124a76b9fdd0b2d42efa23 (DEFAULT_TABLE table=test-table [id=bb8c2738263b4c8487ade702ce65ab26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:18:21.749927 29085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e35af115d124a76b9fdd0b2d42efa23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:18:21.753976 29661 tablet_bootstrap.cc:492] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c: Bootstrap starting.
I20260811 07:18:21.757010 29654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.736371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:36751 (local address 127.0.0.1:47504)
0811 07:18:21.743379 (+ 7008us) negotiation.cc:107] Waiting for socket to connect
0811 07:18:21.743389 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:18:21.743430 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:18:21.749085 (+ 5655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:18:21.749086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:18:21.749099 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:18:21.749188 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.749190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.752311 (+ 3121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.752313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.753425 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.753428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.756772 (+ 3344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.756774 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.756835 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.756839 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:18:21.756888 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 07:18:21.756932 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6990,"thread_start_us":119,"threads_started":1}
I20260811 07:18:21.757036 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.736505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47504 (local address 127.9.142.131:36751)
0811 07:18:21.748539 (+ 12034us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.748544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.748555 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:18:21.748602 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.748604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.748620 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.749273 (+ 653us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:18:21.749373 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.752183 (+ 2810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.756112 (+ 3929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.756676 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.756774 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.756884 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.756912 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.756947 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11983,"thread_start_us":90,"threads_started":1}
I20260811 07:18:21.758227 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.735493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:40087 (local address 127.0.0.1:58654)
0811 07:18:21.736559 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0811 07:18:21.736604 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:18:21.736674 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:18:21.748930 (+ 12256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:18:21.748931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:18:21.748934 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:18:21.748979 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.748981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.753957 (+ 4976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.753958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.755976 (+ 2018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.755979 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.758002 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.758003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.758065 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.758070 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:18:21.758113 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 07:18:21.758156 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1032,"thread_start_us":137,"threads_started":1}
I20260811 07:18:21.758260 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.735649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58654 (local address 127.9.142.130:40087)
0811 07:18:21.748299 (+ 12650us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.748305 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.748317 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:18:21.748366 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.748368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.748724 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.748804 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:18:21.749441 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.751940 (+ 2499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.757314 (+ 5374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.757903 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.758001 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.758098 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.758140 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.758175 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12594,"thread_start_us":142,"threads_started":1}
I20260811 07:18:21.759119 29521 tablet_service.cc:1467] Processing CreateTablet for tablet 6e35af115d124a76b9fdd0b2d42efa23 (DEFAULT_TABLE table=test-table [id=bb8c2738263b4c8487ade702ce65ab26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:18:21.759503 29521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e35af115d124a76b9fdd0b2d42efa23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:18:21.760462 29299 tablet_service.cc:1467] Processing CreateTablet for tablet 6e35af115d124a76b9fdd0b2d42efa23 (DEFAULT_TABLE table=test-table [id=bb8c2738263b4c8487ade702ce65ab26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:18:21.760802 29299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e35af115d124a76b9fdd0b2d42efa23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:18:21.763283 29662 tablet_bootstrap.cc:492] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: Bootstrap starting.
I20260811 07:18:21.764495 29662 tablet_bootstrap.cc:654] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: Neither blocks nor log segments found. Creating new log.
I20260811 07:18:21.764870 29662 log.cc:824] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:18:21.765632 29662 tablet_bootstrap.cc:492] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: No bootstrap required, opened a new log
I20260811 07:18:21.765699 29662 ts_tablet_manager.cc:1397] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:18:21.767885 29661 tablet_bootstrap.cc:654] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c: Neither blocks nor log segments found. Creating new log.
I20260811 07:18:21.767867 29662 raft_consensus.cc:348] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } }
I20260811 07:18:21.768059 29662 raft_consensus.cc:374] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:18:21.768095 29662 raft_consensus.cc:729] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1212913680547048add9aef9dc279b5, State: Initialized, Role: FOLLOWER
I20260811 07:18:21.768208 29662 consensus_queue.cc:260] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } }
I20260811 07:18:21.768349 29661 log.cc:824] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:18:21.768491 29662 ts_tablet_manager.cc:1428] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:18:21.768698 29630 heartbeater.cc:503] Master 127.9.142.190:42141 was elected leader, sending a full tablet report...
I20260811 07:18:21.769186 29666 tablet_bootstrap.cc:492] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: Bootstrap starting.
I20260811 07:18:21.770855 29666 tablet_bootstrap.cc:654] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: Neither blocks nor log segments found. Creating new log.
I20260811 07:18:21.771176 29666 log.cc:824] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: Log is configured to *not* fsync() on all Append() calls
I20260811 07:18:21.771806 29661 tablet_bootstrap.cc:492] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c: No bootstrap required, opened a new log
I20260811 07:18:21.771948 29661 ts_tablet_manager.cc:1397] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20260811 07:18:21.772059 29666 tablet_bootstrap.cc:492] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: No bootstrap required, opened a new log
I20260811 07:18:21.772183 29666 ts_tablet_manager.cc:1397] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:18:21.774727 29666 raft_consensus.cc:348] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } }
I20260811 07:18:21.774760 29661 raft_consensus.cc:348] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } }
I20260811 07:18:21.774914 29661 raft_consensus.cc:374] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:18:21.774952 29666 raft_consensus.cc:374] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:18:21.775007 29666 raft_consensus.cc:729] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0fcc9e1bf834ac5a2a89b61a0757c14, State: Initialized, Role: FOLLOWER
I20260811 07:18:21.775060 29661 raft_consensus.cc:729] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ff91a2a54346f58668612ebc13d57c, State: Initialized, Role: FOLLOWER
I20260811 07:18:21.775193 29666 consensus_queue.cc:260] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } }
I20260811 07:18:21.775264 29661 consensus_queue.cc:260] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } }
I20260811 07:18:21.775534 29666 ts_tablet_manager.cc:1428] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:18:21.775600 29661 ts_tablet_manager.cc:1428] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 07:18:21.775698 29412 heartbeater.cc:503] Master 127.9.142.190:42141 was elected leader, sending a full tablet report...
I20260811 07:18:21.775830 29178 heartbeater.cc:503] Master 127.9.142.190:42141 was elected leader, sending a full tablet report...
W20260811 07:18:21.839586 29179 tablet.cc:2369] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:18:21.877779 29413 tablet.cc:2369] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:18:21.885800 29672 raft_consensus.cc:482] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:18:21.885980 29672 raft_consensus.cc:504] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } }
I20260811 07:18:21.886425 29672 leader_election.cc:288] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0fcc9e1bf834ac5a2a89b61a0757c14 (127.9.142.130:40087), e1212913680547048add9aef9dc279b5 (127.9.142.131:36751)
I20260811 07:18:21.891036 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.887042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:34001 (local address 127.9.142.130:40087)
0811 07:18:21.887091 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.887092 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.887193 (+ 101us) server_negotiation.cc:407] Connection header received
0811 07:18:21.887289 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.887291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.887303 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.887333 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:18:21.887573 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.888422 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.890118 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.890637 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.890686 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.890695 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.890921 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.890964 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 07:18:21.891077 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.886933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:59441 (local address 127.9.142.131:36751)
0811 07:18:21.886986 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.886988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.887109 (+ 121us) server_negotiation.cc:407] Connection header received
0811 07:18:21.887145 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.887146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.887156 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.887220 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:18:21.887630 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.888391 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.890110 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.890653 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.890705 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.890714 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.890953 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.891002 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 07:18:21.891242 29673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.886658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:40087 (local address 127.9.142.129:34001)
0811 07:18:21.887139 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0811 07:18:21.887149 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:18:21.887215 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:18:21.887400 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:18:21.887401 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:18:21.887402 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:18:21.887498 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.887500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.888560 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.888561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.890004 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.890007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.890754 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.890754 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.890828 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.890832 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:18:21.891116 (+ 284us) client_negotiation.cc:240] Negotiation successful
0811 07:18:21.891158 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":49,"thread_start_us":95,"threads_started":1}
I20260811 07:18:21.891587 29332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e35af115d124a76b9fdd0b2d42efa23" candidate_uuid: "25ff91a2a54346f58668612ebc13d57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" is_pre_election: true
I20260811 07:18:21.891781 29332 raft_consensus.cc:2454] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ff91a2a54346f58668612ebc13d57c in term 0.
I20260811 07:18:21.892081 28996 leader_election.cc:302] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ff91a2a54346f58668612ebc13d57c, d0fcc9e1bf834ac5a2a89b61a0757c14; no voters:
I20260811 07:18:21.892223 29672 raft_consensus.cc:2781] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:18:21.892284 29672 raft_consensus.cc:482] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:18:21.892313 29672 raft_consensus.cc:3037] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:18:21.893370 29672 raft_consensus.cc:504] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } }
I20260811 07:18:21.893533 29672 leader_election.cc:288] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [CANDIDATE]: Term 1 election: Requested vote from peers d0fcc9e1bf834ac5a2a89b61a0757c14 (127.9.142.130:40087), e1212913680547048add9aef9dc279b5 (127.9.142.131:36751)
I20260811 07:18:21.892174 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.886624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:36751 (local address 127.9.142.129:59441)
0811 07:18:21.886981 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0811 07:18:21.886993 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:18:21.887059 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:18:21.887414 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:18:21.887415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:18:21.887417 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:18:21.887522 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.887524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.888670 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.888671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.889996 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:18:21.889999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.890775 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.890776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:18:21.890863 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.890867 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:18:21.891785 (+ 918us) client_negotiation.cc:240] Negotiation successful
0811 07:18:21.892032 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":1,"thread_start_us":123,"threads_started":1}
I20260811 07:18:21.893935 29332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e35af115d124a76b9fdd0b2d42efa23" candidate_uuid: "25ff91a2a54346f58668612ebc13d57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14"
I20260811 07:18:21.894022 29332 raft_consensus.cc:3037] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:18:21.894892 29332 raft_consensus.cc:2454] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ff91a2a54346f58668612ebc13d57c in term 1.
I20260811 07:18:21.895116 28996 leader_election.cc:302] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25ff91a2a54346f58668612ebc13d57c, d0fcc9e1bf834ac5a2a89b61a0757c14; no voters:
I20260811 07:18:21.895109 29549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e35af115d124a76b9fdd0b2d42efa23" candidate_uuid: "25ff91a2a54346f58668612ebc13d57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1212913680547048add9aef9dc279b5" is_pre_election: true
I20260811 07:18:21.895200 29672 raft_consensus.cc:2781] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:18:21.895248 29549 raft_consensus.cc:2454] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25ff91a2a54346f58668612ebc13d57c in term 0.
I20260811 07:18:21.895344 29672 raft_consensus.cc:686] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [term 1 LEADER]: Becoming Leader. State: Replica: 25ff91a2a54346f58668612ebc13d57c, State: Running, Role: LEADER
I20260811 07:18:21.895361 29532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e35af115d124a76b9fdd0b2d42efa23" candidate_uuid: "25ff91a2a54346f58668612ebc13d57c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1212913680547048add9aef9dc279b5"
I20260811 07:18:21.895416 29532 raft_consensus.cc:3037] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:18:21.895444 29672 consensus_queue.cc:237] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } }
I20260811 07:18:21.896276 29532 raft_consensus.cc:2454] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25ff91a2a54346f58668612ebc13d57c in term 1.
I20260811 07:18:21.896387 28843 catalog_manager.cc:5495] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c reported cstate change: term changed from 0 to 1, leader changed from <none> to 25ff91a2a54346f58668612ebc13d57c (127.9.142.129). New cstate: current_term: 1 leader_uuid: "25ff91a2a54346f58668612ebc13d57c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25ff91a2a54346f58668612ebc13d57c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 34309 } health_report { overall_health: HEALTHY } } }
I20260811 07:18:21.923281 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.920000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57108 (local address 127.9.142.129:34309)
0811 07:18:21.920042 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 07:18:21.920044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:18:21.920053 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:18:21.920100 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:18:21.920101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:18:21.920123 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:18:21.920198 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:18:21.920361 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.921113 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.922255 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:18:21.922559 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:18:21.922637 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:18:21.922832 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:18:21.922979 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:18:21.923067 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:18:21.923147 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 07:18:21.923175 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:18:21.925451 29532 raft_consensus.cc:1261] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [term 1 FOLLOWER]: Refusing update from remote peer 25ff91a2a54346f58668612ebc13d57c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:18:21.925501 29332 raft_consensus.cc:1261] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [term 1 FOLLOWER]: Refusing update from remote peer 25ff91a2a54346f58668612ebc13d57c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:18:21.925900 29676 consensus_queue.cc:1035] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1212913680547048add9aef9dc279b5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:18:21.926101 29672 consensus_queue.cc:1035] T 6e35af115d124a76b9fdd0b2d42efa23 P 25ff91a2a54346f58668612ebc13d57c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0fcc9e1bf834ac5a2a89b61a0757c14" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 40087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:18:21.928845 29631 tablet.cc:2369] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:18:21.929029 29679 mvcc.cc:205] Tried to move back new op lower bound from 7317228347083337728 to 7317228346964205568. Current Snapshot: MvccSnapshot[applied={T|T < 7317228347083337728}]
I20260811 07:18:21.930400 29682 mvcc.cc:205] Tried to move back new op lower bound from 7317228347083337728 to 7317228346964205568. Current Snapshot: MvccSnapshot[applied={T|T < 7317228347083337728}]
I20260811 07:18:21.931211 29681 mvcc.cc:205] Tried to move back new op lower bound from 7317228347083337728 to 7317228346964205568. Current Snapshot: MvccSnapshot[applied={T|T < 7317228347083337728}]
I20260811 07:18:21.931874 28843 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:18:21.931972 28843 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:18:21.932849 28843 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9fa97cccaad84efba50ac24327f69786: Sending DeleteTablet for 3 replicas of tablet 6e35af115d124a76b9fdd0b2d42efa23
I20260811 07:18:21.933336 29299 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e35af115d124a76b9fdd0b2d42efa23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:18:21 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:58654
I20260811 07:18:21.933557 29085 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e35af115d124a76b9fdd0b2d42efa23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:18:21 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:57100
I20260811 07:18:21.933786 29521 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e35af115d124a76b9fdd0b2d42efa23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:18:21 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:47504
I20260811 07:18:21.934640 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 28970
I20260811 07:18:21.958635 29698 tablet_replica.cc:330] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: stopping tablet replica
I20260811 07:18:21.958902 29698 raft_consensus.cc:2229] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:18:21.959187 29698 raft_consensus.cc:2258] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:18:21.960139 29698 ts_tablet_manager.cc:1905] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:18:21.962565 29698 ts_tablet_manager.cc:1918] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:18:21.962725 29698 log.cc:1196] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/6e35af115d124a76b9fdd0b2d42efa23
I20260811 07:18:21.963070 29698 ts_tablet_manager.cc:1939] T 6e35af115d124a76b9fdd0b2d42efa23 P d0fcc9e1bf834ac5a2a89b61a0757c14: Deleting consensus metadata
I20260811 07:18:21.963668 28821 catalog_manager.cc:4841] TS d0fcc9e1bf834ac5a2a89b61a0757c14 (127.9.142.130:40087): tablet 6e35af115d124a76b9fdd0b2d42efa23 (table test-table [id=bb8c2738263b4c8487ade702ce65ab26]) successfully deleted
I20260811 07:18:21.964015 29700 tablet_replica.cc:330] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: stopping tablet replica
I20260811 07:18:21.964239 29700 raft_consensus.cc:2229] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:18:21.964469 29700 raft_consensus.cc:2258] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 07:18:21.965090 28821 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:34309 (error 108)
I20260811 07:18:21.965147 29700 ts_tablet_manager.cc:1905] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:18:21.965839 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 29187
I20260811 07:18:21.968940 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:18:21.966006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:34309 (local address 127.0.0.1:57114)
0811 07:18:21.968821 (+ 2815us) negotiation.cc:107] Waiting for socket to connect
0811 07:18:21.968889 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:34309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2787}
I20260811 07:18:21.984947 29700 ts_tablet_manager.cc:1918] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:18:21.985059 29700 log.cc:1196] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/6e35af115d124a76b9fdd0b2d42efa23
I20260811 07:18:21.985472 29700 ts_tablet_manager.cc:1939] T 6e35af115d124a76b9fdd0b2d42efa23 P e1212913680547048add9aef9dc279b5: Deleting consensus metadata
W20260811 07:18:21.985757 28821 catalog_manager.cc:4584] TS 25ff91a2a54346f58668612ebc13d57c (127.9.142.129:34309): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6e35af115d124a76b9fdd0b2d42efa23: Network error: Client connection negotiation failed: client connection to 127.9.142.129:34309: connect: Connection refused (error 111)
I20260811 07:18:21.986047 28823 catalog_manager.cc:4841] TS e1212913680547048add9aef9dc279b5 (127.9.142.131:36751): tablet 6e35af115d124a76b9fdd0b2d42efa23 (table test-table [id=bb8c2738263b4c8487ade702ce65ab26]) successfully deleted
I20260811 07:18:21.991585 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 29419
I20260811 07:18:22.004981 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 28794
I20260811 07:18:22.021004 9786 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 07:18:22.367800 9786 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 07:18:22.367942 9786 mini_ranger.cc:66] Stopping Ranger...
I20260811 07:18:22.723521 9786 mini_ranger.cc:68] Stopped Ranger
2026-08-11 07:18:22.723 UTC [28124] LOG: received smart shutdown request
2026-08-11 07:18:22.727 UTC [28124] LOG: background worker "logical replication launcher" (PID 28134) exited with exit code 1
2026-08-11 07:18:22.728 UTC [28128] LOG: shutting down
2026-08-11 07:18:22.906 UTC [28124] LOG: database system is shut down
2026-08-11T07:18:22Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50675 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:18:23 dist-test-slave-7f01 krb5kdc[29716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:18:23 dist-test-slave-7f01 krb5kdc[29716](info): set up 2 sockets
Aug 11 07:18:23 dist-test-slave-7f01 krb5kdc[29716](info): commencing operation
krb5kdc: starting...
W20260811 07:18:24.334888 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:18:24 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:18:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:18:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.142.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.142.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/rangeradmin_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/rangeradmin_127.9.142.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.142.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.142.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/rangerlookup_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/rangerlookup_127.9.142.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.142.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.142.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/HTTP_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/HTTP_127.9.142.148@KRBTEST.COM.keytab.
I20260811 07:18:24.535439 9786 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNunSB7/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/postgres -l logfile start
2026-08-11 07:18:27.211 UTC [29770] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 07:18:27.211 UTC [29770] LOG: listening on IPv4 address "127.9.142.148", port 38329
2026-08-11 07:18:27.215 UTC [29770] LOG: listening on Unix socket "/tmp/.s.PGSQL.38329"
2026-08-11 07:18:27.253 UTC [29773] LOG: database system was shut down at 2026-08-11 07:18:25 UTC
2026-08-11 07:18:27.258 UTC [29770] LOG: database system is ready to accept connections
I20260811 07:18:28.501729 9786 mini_postgres.cc:96] Postgres bound to 38329
2026-08-11 07:18:28.509 UTC [29783] FATAL: database "slave" does not exist
127.9.142.148:38329 - accepting connections
I20260811 07:18:28.509740 9786 mini_ranger.cc:161] Starting Ranger...
I20260811 07:18:28.525661 9786 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 07:18:29.013573 9786 mini_ranger.cc:87] Created ranger Postgres database
I20260811 07:18:29.013680 9786 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-admin
2026-08-11 07:18:29,314 [I] DB FLAVOR :POSTGRES
2026-08-11 07:18:29,315 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:18:29,315 [I] Checking connection..
2026-08-11 07:18:29,315 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 07:18:29,592 [I] Checking connection passed.
2026-08-11 07:18:29,592 [I] --------- Verifying version history table ---------
2026-08-11 07:18:29,593 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:18:29,862 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:18:29,863 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:18:30,117 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:18:30,117 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 07:18:30,117 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 07:18:30.392 UTC [29890] WARNING: there is no transaction in progress
2026-08-11 07:18:30,403 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 07:18:30,404 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:18:30,670 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 07:18:30,670 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:18:30,671 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 07:18:30,930 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 07:18:31,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7f01.c.gcp-upstream.internal','N') ;"
2026-08-11 07:18:31,439 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:18:31,685 [I] Table x_portal_user does not exist in database ranger
2026-08-11 07:18:31,685 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:18:31,929 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 07:18:31,929 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:18:32,194 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:18:32,458 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 07:18:32,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 07:18:33.381 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.396 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.412 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.426 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.441 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.458 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.511 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.518 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.531 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.541 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.551 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.564 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.574 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.580 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.587 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:33.594 UTC [30059] WARNING: there is no transaction in progress
2026-08-11 07:18:34,236 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 07:18:34,236 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 07:18:34,471 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 07:18:34,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:18:34,742 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 07:18:34,743 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:18:35,010 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 07:18:35,010 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:18:35,246 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:18:35,498 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7f01.c.gcp-upstream.internal';"
2026-08-11 07:18:35,742 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 07:18:35,743 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 07:18:36,006 [I] DB_PATCHES have already been applied
I20260811 07:18:36.012843 9786 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNunSB7/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 07:18:36.012916 9786 mini_ranger.cc:193] Using host: 127.9.142.148
I20260811 07:18:36.017177 9786 mini_ranger.cc:227] Ranger admin URL: http://127.9.142.148:42831
Aug 11, 2026 7:18:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:18:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:18:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 7:18:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 7:18:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 7:18:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 7:18:36 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 07:18:37.393867 9786 mini_ranger.cc:160] Time spent starting Ranger: real 8.884s user 0.002s sys 0.009s
Aug 11, 2026 7:18:57 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 7:18:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 7:18:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 7:18:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 7:18:58 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 07:18:58.651929 9786 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.142.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.142.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/rangerkms_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.142.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/rangerkms_127.9.142.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.142.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.142.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.142.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/HTTP_127.9.142.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.142.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/HTTP_127.9.142.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 07:18:58 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432738, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 07:18:58.764817 9786 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 07:18:58.776654 9786 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 07:18:59.670821 9786 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 07:18:59.670928 9786 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-kms
I20260811 07:18:59.670953 9786 mini_ranger_kms.cc:227] Using postgres at 127.9.142.148:38329
2026-08-11 07:18:59,865 [I] DB FLAVOR :POSTGRES
2026-08-11 07:18:59,865 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:18:59,865 [I] Checking connection
2026-08-11 07:18:59,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 07:19:00,119 [I] connection success
2026-08-11 07:19:00,120 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 07:19:00,120 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 07:19:00,120 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 07:19:00,364 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 07:19:00,364 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:19:00,364 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 07:19:00,365 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.142.148:38329/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 07:19:00,645 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 07:19:01.134023 9786 mini_ranger_kms.cc:310] Created kms service
I20260811 07:19:01.350729 9786 mini_ranger_kms.cc:326] Created kudu user
I20260811 07:19:01.397076 9786 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 07:19:01 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432738, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:01.811817 9786 mini_ranger_kms.cc:384] Added ranger policy
I20260811 07:19:01.811944 9786 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNunSB7/build/release/bin/postgresql.jar:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNunSB7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 07:19:01.811964 9786 mini_ranger_kms.cc:240] Using host: 127.9.142.148
I20260811 07:19:01.819273 9786 mini_ranger_kms.cc:276] Ranger KMS PID: 30368
I20260811 07:19:01.819379 9786 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.142.148:45243
Aug 11, 2026 7:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:19:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 7:19:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 7:19:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 7:19:03 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 07:19:04 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786432744, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.142.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 07:19:04 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432744, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.142.148@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:04.785748 9786 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.021s user 0.010s sys 0.166s
I20260811 07:19:04.785847 9786 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 07:19:04.785893 9786 mini_ranger_kms.cc:401] 127.9.142.148:45243/kms/v1/keys
Aug 11 07:19:05 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432744, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.142.148@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
Aug 11 07:19:07 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:19:07.332918 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:44731
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:44219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:44731
--ranger_config_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:45243/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:07.422937 30455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:07.423208 30455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:07.423249 30455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:07.424542 30455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:07.424639 30455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:07.424665 30455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:07.424695 30455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:07.424728 30455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:07.426694 30455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:44219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.142.148:45243/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:44731
--ranger_config_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:44731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:07.427022 30455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:07.427280 30455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:07.432960 30463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:07.432955 30465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:07.433036 30462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:07.433140 30455 server_base.cc:1034] running on GCE node
I20260811 07:19:07.433488 30455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:07.433851 30455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:07.435034 30455 hybrid_clock.cc:648] HybridClock initialized: now 1786432747435019 us; error 48 us; skew 500 ppm
Aug 11 07:19:07 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432747, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:07.438016 30455 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:19:07.438563 30455 webserver.cc:460] Webserver started at http://127.9.142.190:41175/ using document root <none> and password file <none>
I20260811 07:19:07.438840 30455 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:07.438912 30455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:07.439095 30455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:19:07 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432747, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:07.504542 30455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "26edf640300b426ea5e411fa2ad1a749"
format_stamp: "Formatted at 2026-08-11 07:19:07 on dist-test-slave-7f01"
server_key: "f015cd496653ac26ab549e0ef99a6597"
server_key_iv: "46797501d3201088e514ff32472eb5be"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:07.505149 30455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "26edf640300b426ea5e411fa2ad1a749"
format_stamp: "Formatted at 2026-08-11 07:19:07 on dist-test-slave-7f01"
server_key: "f015cd496653ac26ab549e0ef99a6597"
server_key_iv: "46797501d3201088e514ff32472eb5be"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:07.507561 30455 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 07:19:07.523943 30479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:07.524150 30455 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:19:07.524256 30455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "26edf640300b426ea5e411fa2ad1a749"
format_stamp: "Formatted at 2026-08-11 07:19:07 on dist-test-slave-7f01"
server_key: "f015cd496653ac26ab549e0ef99a6597"
server_key_iv: "46797501d3201088e514ff32472eb5be"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:07.524365 30455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:07.539471 30455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:07.541822 30455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:07.541961 30455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:07.546751 30455 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:44731
I20260811 07:19:07.546818 30569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:44731 every 8 connection(s)
I20260811 07:19:07.547209 30455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:19:07.548039 30570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:07.550521 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 30455
I20260811 07:19:07.550535 30570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Bootstrap starting.
I20260811 07:19:07.550648 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:19:07.550850 9786 external_mini_cluster.cc:1428] Setting key da3fe7634c79860c817eb424d3b04fbd
I20260811 07:19:07.551383 30570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:07.551895 30570 log.cc:824] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:07.552750 30570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: No bootstrap required, opened a new log
I20260811 07:19:07.555408 30570 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } }
I20260811 07:19:07.555565 30570 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:07.555593 30570 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26edf640300b426ea5e411fa2ad1a749, State: Initialized, Role: FOLLOWER
I20260811 07:19:07.555768 30570 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } }
I20260811 07:19:07.555866 30570 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:19:07.555927 30570 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:19:07.556011 30570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:07.556599 30570 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } }
I20260811 07:19:07.556739 30570 leader_election.cc:302] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26edf640300b426ea5e411fa2ad1a749; no voters:
I20260811 07:19:07.556972 30570 leader_election.cc:288] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:19:07.557005 30578 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:07.557199 30578 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 1 LEADER]: Becoming Leader. State: Replica: 26edf640300b426ea5e411fa2ad1a749, State: Running, Role: LEADER
I20260811 07:19:07.557353 30570 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:19:07.557350 30578 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } }
I20260811 07:19:07.557900 30581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26edf640300b426ea5e411fa2ad1a749. Latest consensus state: current_term: 1 leader_uuid: "26edf640300b426ea5e411fa2ad1a749" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } } }
I20260811 07:19:07.558203 30581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:07.558113 30580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26edf640300b426ea5e411fa2ad1a749" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } } }
I20260811 07:19:07.558830 30580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:07.558892 30602 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 07:19:07 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:07.559471 30602 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:19:07.559891 30570 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:19:07.564785 30602 catalog_manager.cc:1347] Generated new cluster ID: fa7a3d1186f94238ba7421feb8de00e5
I20260811 07:19:07.564924 30602 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:19:07.574463 30575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:07.551471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43916 (local address 127.9.142.190:44731)
0811 07:19:07.551705 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:07.551716 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:07.551777 (+ 61us) server_negotiation.cc:407] Connection header received
0811 07:19:07.552373 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:07.552384 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:07.552457 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:07.552624 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:07.553339 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:07.555004 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:07.555964 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:07.556453 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:07.556587 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:07.559712 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:07.559716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:07.559717 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:07.559731 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:07.572225 (+ 12494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:07.572731 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:07.572734 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:07.572735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:07.572865 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:07.573093 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:07.573094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:07.573094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:07.573436 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:07.573994 (+ 558us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:07.574071 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 07:19:07.574229 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":109,"threads_started":1}
I20260811 07:19:07.575999 30602 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:19:07.576741 30602 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:19:07.579835 30602 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Generated new TSK 0
I20260811 07:19:07.580003 30602 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:19:08.346901 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:45243/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44731
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:44219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:08.461040 30647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:08.461272 30647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:08.461319 30647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:08.462491 30647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:08.462566 30647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:08.462611 30647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:19:08.464339 30647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:44219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.142.148:45243/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:08.464612 30647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:08.464877 30647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:08.470997 30652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:08.470990 30662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:08.471338 30647 server_base.cc:1034] running on GCE node
W20260811 07:19:08.471083 30654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:08.471705 30647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:08.472009 30647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:08.473186 30647 hybrid_clock.cc:648] HybridClock initialized: now 1786432748473170 us; error 32 us; skew 500 ppm
Aug 11 07:19:08 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432748, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:08.476368 30647 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:19:08.476892 30647 webserver.cc:460] Webserver started at http://127.9.142.129:35681/ using document root <none> and password file <none>
I20260811 07:19:08.477185 30647 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:08.477260 30647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:08.477392 30647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:19:08 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432748, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:08.502836 30647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "5b422563f8354a75a4f38ecfa420c86b"
format_stamp: "Formatted at 2026-08-11 07:19:08 on dist-test-slave-7f01"
server_key: "930a5748721a306d4194171aafb914dd"
server_key_iv: "a391824b099a2cd7784df6fec45ece89"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:08.503327 30647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "5b422563f8354a75a4f38ecfa420c86b"
format_stamp: "Formatted at 2026-08-11 07:19:08 on dist-test-slave-7f01"
server_key: "930a5748721a306d4194171aafb914dd"
server_key_iv: "a391824b099a2cd7784df6fec45ece89"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:08.505388 30647 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:19:08.520798 30676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:08.521072 30647 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:08.521179 30647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "5b422563f8354a75a4f38ecfa420c86b"
format_stamp: "Formatted at 2026-08-11 07:19:08 on dist-test-slave-7f01"
server_key: "930a5748721a306d4194171aafb914dd"
server_key_iv: "a391824b099a2cd7784df6fec45ece89"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:08.521270 30647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:08.539208 30647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:08.541703 30647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:08.541873 30647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:08.542172 30647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:08.542618 30647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:08.542658 30647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:08.542682 30647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:08.542695 30647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:08.550336 30647 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:43241
I20260811 07:19:08.550420 30851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:43241 every 8 connection(s)
I20260811 07:19:08.550737 30647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:19:08.555521 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 30647
I20260811 07:19:08.555622 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:19:08.555874 9786 external_mini_cluster.cc:1428] Setting key b9207d6258301a476bbe3d3085933ef7
Aug 11 07:19:08 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432748, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:08.565186 30855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:08.551524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:44731 (local address 127.9.142.129:34593)
0811 07:19:08.551697 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:08.551765 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:08.552320 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:08.554846 (+ 2526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:08.554851 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:08.555125 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:08.555403 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:08.555410 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:08.556737 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:08.556738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:08.558212 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:08.558215 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:08.558726 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:08.558727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:08.558890 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:08.559535 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:08.559546 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:08.561290 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:08.563452 (+ 2162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:08.563459 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:08.563462 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:08.563864 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:08.564086 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:08.564087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:08.564087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:08.564210 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:08.564514 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:08.564521 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:08.564682 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 07:19:08.564779 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 07:19:08.564938 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
I20260811 07:19:08.565987 30856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:08.551540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:34593 (local address 127.9.142.190:44731)
0811 07:19:08.554592 (+ 3052us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:08.554595 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:08.554607 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:19:08.554637 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:08.554638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:08.554651 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:08.554737 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:08.555546 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:08.556631 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:08.558308 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:08.558629 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:08.558696 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:08.561399 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:08.561400 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:08.561400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:08.561409 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:08.563356 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:08.563950 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:08.563951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:08.563951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:08.564019 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:08.564274 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:08.564274 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:08.564275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:08.564412 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:08.564484 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:08.565789 (+ 1305us) server_negotiation.cc:299] Negotiation successful
0811 07:19:08.565885 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3016,"thread_start_us":91,"threads_started":1}
I20260811 07:19:08.566573 30852 heartbeater.cc:347] Connected to a master server at 127.9.142.190:44731
I20260811 07:19:08.566726 30852 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:08.567006 30852 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
I20260811 07:19:08.567607 30507 ts_manager.cc:194] Registered new tserver with Master: 5b422563f8354a75a4f38ecfa420c86b (127.9.142.129:43241)
I20260811 07:19:08.568559 30507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:34593
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:19:08.610910 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:45243/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44731
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:44219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:19:08 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786432748, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 07:19:08.730336 30864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:08.730635 30864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:08.730672 30864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:08.732463 30864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:08.732535 30864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:08.732578 30864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:19:08.734782 30864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:44219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.142.148:45243/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:08.735049 30864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:08.735371 30864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:19:08.742061 30864 server_base.cc:1034] running on GCE node
W20260811 07:19:08.742182 30879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:08.742246 30882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:08.742533 30872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:08.742838 30864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:08.743136 30864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:08.744334 30864 hybrid_clock.cc:648] HybridClock initialized: now 1786432748744303 us; error 44 us; skew 500 ppm
Aug 11 07:19:08 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432748, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:08.749945 30864 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:19:08.750617 30864 webserver.cc:460] Webserver started at http://127.9.142.130:42273/ using document root <none> and password file <none>
I20260811 07:19:08.750952 30864 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:08.751036 30864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:08.751238 30864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:19:08 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432748, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:08.765230 30864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "ba4f3d0bd68945c49a995c697cce516b"
format_stamp: "Formatted at 2026-08-11 07:19:08 on dist-test-slave-7f01"
server_key: "c3ed394ad712d86b34c0c9e212d7d6a4"
server_key_iv: "39bdedc7c22e339ce0ed6ef49cd18784"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:08.765735 30864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "ba4f3d0bd68945c49a995c697cce516b"
format_stamp: "Formatted at 2026-08-11 07:19:08 on dist-test-slave-7f01"
server_key: "c3ed394ad712d86b34c0c9e212d7d6a4"
server_key_iv: "39bdedc7c22e339ce0ed6ef49cd18784"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:08.771147 30864 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:19:08.795226 30893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:08.795504 30864 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260811 07:19:08.795603 30864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "ba4f3d0bd68945c49a995c697cce516b"
format_stamp: "Formatted at 2026-08-11 07:19:08 on dist-test-slave-7f01"
server_key: "c3ed394ad712d86b34c0c9e212d7d6a4"
server_key_iv: "39bdedc7c22e339ce0ed6ef49cd18784"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:08.795701 30864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:08.813858 30864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:08.816843 30864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:08.817106 30864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:08.817400 30864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:08.817905 30864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:08.818008 30864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:08.818075 30864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:08.818125 30864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:08.825634 30864 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:34879
I20260811 07:19:08.826227 30864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:19:08.829600 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 30864
I20260811 07:19:08.829718 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:19:08.829981 9786 external_mini_cluster.cc:1428] Setting key e9c71360fd38f2411eeae3c838fdfc8e
I20260811 07:19:08.829120 31070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:34879 every 8 connection(s)
Aug 11 07:19:08 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432748, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:08.842828 30856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:08.829067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:51465 (local address 127.9.142.190:44731)
0811 07:19:08.829122 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:08.829125 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:08.829639 (+ 514us) server_negotiation.cc:407] Connection header received
0811 07:19:08.831054 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:08.831055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:08.831074 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:08.831111 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:08.832125 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:08.832981 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:08.834811 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:08.835171 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:08.835222 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:08.838581 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:08.838582 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:08.838583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:08.838592 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:08.840773 (+ 2181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:08.841397 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:08.841398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:08.841399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:08.841473 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:08.841817 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:08.841818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:08.841818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:08.842002 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:08.842056 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:08.842608 (+ 552us) server_negotiation.cc:299] Negotiation successful
0811 07:19:08.842725 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:19:08.843643 31077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:08.828198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:44731 (local address 127.9.142.130:51465)
0811 07:19:08.829487 (+ 1289us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:08.829536 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:08.830904 (+ 1368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:08.831321 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:08.831326 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:08.831629 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:08.832007 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:08.832013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:08.833244 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:08.833245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:08.834692 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:08.834695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:08.835332 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:08.835333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:08.835508 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:08.836265 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:08.836278 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:08.838436 (+ 2158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:08.840897 (+ 2461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:08.840919 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:08.840922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:08.841284 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:08.841560 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:08.841561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:08.841561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:08.841720 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:08.842117 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:08.842125 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:08.842317 (+ 192us) client_negotiation.cc:769] Sending connection context
0811 07:19:08.843193 (+ 876us) client_negotiation.cc:240] Negotiation successful
0811 07:19:08.843385 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1244,"thread_start_us":627,"threads_started":1}
I20260811 07:19:08.844434 31073 heartbeater.cc:347] Connected to a master server at 127.9.142.190:44731
I20260811 07:19:08.844544 31073 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:08.844766 31073 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
I20260811 07:19:08.845270 30507 ts_manager.cc:194] Registered new tserver with Master: ba4f3d0bd68945c49a995c697cce516b (127.9.142.130:34879)
I20260811 07:19:08.845786 30507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:51465
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:19:08.879012 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:45243/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44731
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:44219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:09.017356 31086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:09.017746 31086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:09.017845 31086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:09.019680 31086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:09.019815 31086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:09.019913 31086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:19:09.022171 31086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:44219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.142.148:45243/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:09.022464 31086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:09.022768 31086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:09.029584 31097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:09.029866 31095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:09.030825 31100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:09.031150 31086 server_base.cc:1034] running on GCE node
I20260811 07:19:09.031514 31086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:09.031843 31086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:09.033034 31086 hybrid_clock.cc:648] HybridClock initialized: now 1786432749033007 us; error 38 us; skew 500 ppm
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:09.036695 31086 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:19:09.037230 31086 webserver.cc:460] Webserver started at http://127.9.142.131:41403/ using document root <none> and password file <none>
I20260811 07:19:09.037544 31086 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:09.037604 31086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:09.037735 31086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:09.061200 31086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e"
format_stamp: "Formatted at 2026-08-11 07:19:09 on dist-test-slave-7f01"
server_key: "a3653850381777dd21c766f2fbb05c09"
server_key_iv: "deb920ee97a478f0c39603ccfcfb318c"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:09.061777 31086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e"
format_stamp: "Formatted at 2026-08-11 07:19:09 on dist-test-slave-7f01"
server_key: "a3653850381777dd21c766f2fbb05c09"
server_key_iv: "deb920ee97a478f0c39603ccfcfb318c"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:09.072880 31086 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.001s sys 0.001s
I20260811 07:19:09.092242 31110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.092566 31086 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260811 07:19:09.092752 31086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e"
format_stamp: "Formatted at 2026-08-11 07:19:09 on dist-test-slave-7f01"
server_key: "a3653850381777dd21c766f2fbb05c09"
server_key_iv: "deb920ee97a478f0c39603ccfcfb318c"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:09.092958 31086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:09.124449 31086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:09.127084 31086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:09.127316 31086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:09.127624 31086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:09.128075 31086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:09.128165 31086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.128242 31086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:09.128314 31086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.138120 31086 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:42357
I20260811 07:19:09.138641 31086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:19:09.139603 31306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:42357 every 8 connection(s)
I20260811 07:19:09.140654 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 31086
I20260811 07:19:09.140760 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:19:09.140954 9786 external_mini_cluster.cc:1428] Setting key 894f127a123d5df70bed4cd8d19a7623
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:09.150560 30856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:09.139840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:38043 (local address 127.9.142.190:44731)
0811 07:19:09.139890 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:09.139892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:09.140207 (+ 315us) server_negotiation.cc:407] Connection header received
0811 07:19:09.140932 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:09.140934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:09.140948 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:09.140979 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:09.141814 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.142623 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.144148 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.144467 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.144509 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:09.147217 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:09.147218 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:09.147219 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:09.147226 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:09.148965 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:09.149465 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:09.149466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:09.149466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:09.149526 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:09.149811 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:09.149811 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:09.149812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:09.149953 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:09.149995 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:09.150371 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 07:19:09.150461 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:19:09.151367 31310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:09.139866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:44731 (local address 127.9.142.131:38043)
0811 07:19:09.140078 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:09.140121 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:09.140804 (+ 683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:09.141168 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:09.141172 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:09.141429 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:09.141707 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:09.141713 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.142741 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.142741 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:09.144047 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:09.144050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.144615 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.144616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:09.144755 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:09.145381 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:09.145392 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:09.147105 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:09.149065 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:09.149072 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:09.149074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:09.149375 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:09.149596 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:09.149596 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:09.149597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:09.149733 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:09.150041 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:09.150047 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:09.150207 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 07:19:09.150906 (+ 699us) client_negotiation.cc:240] Negotiation successful
0811 07:19:09.151079 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":90,"threads_started":1}
I20260811 07:19:09.152089 31308 heartbeater.cc:347] Connected to a master server at 127.9.142.190:44731
I20260811 07:19:09.152185 31308 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:09.152386 31308 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
I20260811 07:19:09.152819 30507 ts_manager.cc:194] Registered new tserver with Master: 1bc88d4a336441eaaa05b1e2d4ed6d7e (127.9.142.131:42357)
I20260811 07:19:09.153321 30507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:38043
I20260811 07:19:09.163394 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:19:09.164433 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 30647
I20260811 07:19:09.215062 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 30864
I20260811 07:19:09.225538 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 31086
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432748, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:09.288730 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 30455
I20260811 07:19:09.310832 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:44731
--webserver_interface=127.9.142.190
--webserver_port=41175
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:44219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:44731
--ranger_config_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:45243/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.142.148:45243/kms with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:09.398712 31311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:09.398944 31311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:09.398968 31311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:09.400213 31311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:09.400259 31311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:09.400274 31311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:09.400286 31311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:09.400298 31311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:09.401894 31311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:44219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.142.148:45243/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:44731
--ranger_config_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:44731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=41175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:09.402144 31311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:09.402391 31311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:09.407294 31320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:09.407536 31311 server_base.cc:1034] running on GCE node
W20260811 07:19:09.407295 31325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:09.407295 31319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:09.407984 31311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:09.408285 31311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:09.409504 31311 hybrid_clock.cc:648] HybridClock initialized: now 1786432749409488 us; error 32 us; skew 500 ppm
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:09.412262 31311 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:19:09.412794 31311 webserver.cc:460] Webserver started at http://127.9.142.190:41175/ using document root <none> and password file <none>
I20260811 07:19:09.413033 31311 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:09.413085 31311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:09.487223 31311 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:09.488072 31337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.488252 31311 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:09.488375 31311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "26edf640300b426ea5e411fa2ad1a749"
format_stamp: "Formatted at 2026-08-11 07:19:07 on dist-test-slave-7f01"
server_key: "f015cd496653ac26ab549e0ef99a6597"
server_key_iv: "46797501d3201088e514ff32472eb5be"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:09.488756 31311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:09.499485 31311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:09.501099 31311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:09.501263 31311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:09.505725 31311 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:44731
I20260811 07:19:09.505772 31418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:44731 every 8 connection(s)
I20260811 07:19:09.506141 31311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:19:09.507376 31420 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:19:09.508121 31420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Bootstrap starting.
I20260811 07:19:09.508303 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 31311
I20260811 07:19:09.508630 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:45243/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:43241
--local_ip_for_outbound_sockets=127.9.142.129
--tserver_master_addrs=127.9.142.190:44731
--webserver_port=35681
--webserver_interface=127.9.142.129
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:44219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.142.148:45243/kms with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:19:09.517303 31420 log.cc:824] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:09.519196 31420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:19:09.519498 31420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Bootstrap complete.
I20260811 07:19:09.522033 31420 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } }
I20260811 07:19:09.522292 31420 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26edf640300b426ea5e411fa2ad1a749, State: Initialized, Role: FOLLOWER
I20260811 07:19:09.522485 31420 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } }
I20260811 07:19:09.522567 31420 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:19:09.522622 31420 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:19:09.522677 31420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:19:09.523792 31420 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } }
I20260811 07:19:09.523923 31420 leader_election.cc:302] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26edf640300b426ea5e411fa2ad1a749; no voters:
I20260811 07:19:09.524127 31420 leader_election.cc:288] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:19:09.524168 31427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:19:09.524279 31427 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [term 2 LEADER]: Becoming Leader. State: Replica: 26edf640300b426ea5e411fa2ad1a749, State: Running, Role: LEADER
I20260811 07:19:09.524415 31420 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:19:09.524477 31427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } }
I20260811 07:19:09.524766 31428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "26edf640300b426ea5e411fa2ad1a749" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } } }
I20260811 07:19:09.524910 31428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:09.524760 31427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26edf640300b426ea5e411fa2ad1a749. Latest consensus state: current_term: 2 leader_uuid: "26edf640300b426ea5e411fa2ad1a749" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26edf640300b426ea5e411fa2ad1a749" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44731 } } }
I20260811 07:19:09.525334 31427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:09.525476 31442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:19:09.526067 31442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:19:09.526257 31442 catalog_manager.cc:1259] Loaded cluster ID: fa7a3d1186f94238ba7421feb8de00e5
I20260811 07:19:09.526333 31442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:19:09.526439 31420 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:19:09.527601 31442 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:19:09.527812 31442 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Loaded TSK: 0
I20260811 07:19:09.528043 31442 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:19:09.622294 31423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:09.622555 31423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:09.622591 31423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:09.624219 31423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:09.624281 31423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:09.624321 31423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:19:09.626448 31423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:44219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.142.148:45243/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:43241
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=35681
--tserver_master_addrs=127.9.142.190:44731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:09.626684 31423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:09.627022 31423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:09.633334 31481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:09.633625 31484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:09.633334 31482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:09.634593 31423 server_base.cc:1034] running on GCE node
I20260811 07:19:09.634799 31423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:09.635075 31423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:09.636258 31423 hybrid_clock.cc:648] HybridClock initialized: now 1786432749636235 us; error 35 us; skew 500 ppm
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:09.639617 31423 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:19:09.640195 31423 webserver.cc:460] Webserver started at http://127.9.142.129:35681/ using document root <none> and password file <none>
I20260811 07:19:09.640511 31423 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:09.640620 31423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:09.670094 31423 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:09.671650 31493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.671936 31423 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:09.672046 31423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "5b422563f8354a75a4f38ecfa420c86b"
format_stamp: "Formatted at 2026-08-11 07:19:08 on dist-test-slave-7f01"
server_key: "930a5748721a306d4194171aafb914dd"
server_key_iv: "a391824b099a2cd7784df6fec45ece89"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:09.672605 31423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:09.681180 31423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:09.683223 31423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:09.683389 31423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:09.683667 31423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:09.684091 31423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:09.684149 31423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.684214 31423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:09.684258 31423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.691540 31423 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:43241
I20260811 07:19:09.691583 31677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:43241 every 8 connection(s)
I20260811 07:19:09.692075 31423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:19:09.695686 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 31423
I20260811 07:19:09.696026 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:45243/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:34879
--local_ip_for_outbound_sockets=127.9.142.130
--tserver_master_addrs=127.9.142.190:44731
--webserver_port=42273
--webserver_interface=127.9.142.130
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:44219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.142.148:45243/kms with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:09.721719 31684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:09.693133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:44731 (local address 127.9.142.129:46825)
0811 07:19:09.703846 (+ 10713us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:09.703907 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:09.704606 (+ 699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:09.705359 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:09.705365 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:09.705672 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:09.705949 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:09.705956 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.707731 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.707732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:09.709065 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:09.709069 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.710073 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.710074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:09.710202 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:09.710820 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:09.710831 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:09.712549 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:09.719695 (+ 7146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:09.719704 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:09.719706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:09.720063 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:09.720364 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:09.720365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:09.720365 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:09.720515 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:09.721023 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:09.721042 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:09.721194 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 07:19:09.721293 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 07:19:09.721466 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10657,"thread_start_us":107,"threads_started":1}
I20260811 07:19:09.722570 31686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:09.693196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:46825 (local address 127.9.142.190:44731)
0811 07:19:09.704843 (+ 11647us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:09.704853 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:09.704895 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:19:09.705048 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:09.705055 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:09.705117 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:09.705267 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:09.706100 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.707603 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.709163 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.709851 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.709955 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:09.712676 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:09.712681 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:09.712681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:09.712693 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:09.719588 (+ 6895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:09.720165 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:09.720169 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:09.720169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:09.720288 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:09.720591 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:09.720593 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:09.720593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:09.720902 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:09.720989 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:09.722211 (+ 1222us) server_negotiation.cc:299] Negotiation successful
0811 07:19:09.722350 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11585,"thread_start_us":71,"threads_started":1}
I20260811 07:19:09.723789 31678 heartbeater.cc:347] Connected to a master server at 127.9.142.190:44731
I20260811 07:19:09.723904 31678 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:09.724114 31678 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
W20260811 07:19:09.727916 31678 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:44731 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:19:09.727998 31678 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:09.728065 31678 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
I20260811 07:19:09.728498 31678 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:09.728578 31678 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
W20260811 07:19:09.728914 31678 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:19:09.834194 31687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:09.834481 31687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:09.834518 31687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:09.836181 31687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:09.836244 31687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:09.836284 31687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:19:09.838433 31687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:44219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.142.148:45243/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:34879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=42273
--tserver_master_addrs=127.9.142.190:44731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:09.838696 31687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:09.838972 31687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:09.844457 31695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:09.844453 31697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:09.844583 31694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:09.845129 31687 server_base.cc:1034] running on GCE node
I20260811 07:19:09.845332 31687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:09.845577 31687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:09.846758 31687 hybrid_clock.cc:648] HybridClock initialized: now 1786432749846746 us; error 33 us; skew 500 ppm
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:09.852073 31687 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:19:09.852558 31687 webserver.cc:460] Webserver started at http://127.9.142.130:42273/ using document root <none> and password file <none>
I20260811 07:19:09.852821 31687 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:09.852902 31687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:09.877722 31687 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 07:19:09.879117 31708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.879379 31687 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:09.879508 31687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "ba4f3d0bd68945c49a995c697cce516b"
format_stamp: "Formatted at 2026-08-11 07:19:08 on dist-test-slave-7f01"
server_key: "c3ed394ad712d86b34c0c9e212d7d6a4"
server_key_iv: "39bdedc7c22e339ce0ed6ef49cd18784"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:09.880172 31687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:09.904691 31687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:09.907035 31687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:09.907188 31687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:09.907483 31687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:09.907924 31687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:09.907980 31687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.908015 31687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:09.908079 31687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:09.915123 31687 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:34879
I20260811 07:19:09.915563 31687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:19:09.919919 31904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:34879 every 8 connection(s)
I20260811 07:19:09.923453 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 31687
I20260811 07:19:09.923786 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.142.148:45243/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:42357
--local_ip_for_outbound_sockets=127.9.142.131
--tserver_master_addrs=127.9.142.190:44731
--webserver_port=41403
--webserver_interface=127.9.142.131
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:44219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.142.148:45243/kms with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:19:09 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432749, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:09.931094 31686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:09.920599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:57999 (local address 127.9.142.190:44731)
0811 07:19:09.920675 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:09.920678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:09.920915 (+ 237us) server_negotiation.cc:407] Connection header received
0811 07:19:09.921461 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:09.921462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:09.921476 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:09.921526 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:09.922092 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.922673 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.923696 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.924043 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.924115 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:09.927639 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:09.927640 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:09.927641 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:09.927648 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:09.929379 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:09.929907 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:09.929909 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:09.929909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:09.929977 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:09.930277 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:09.930278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:09.930278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:09.930417 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:09.930463 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:09.930821 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 07:19:09.930936 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 07:19:09.931291 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:09.920581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:44731 (local address 127.9.142.130:57999)
0811 07:19:09.920773 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:09.920815 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:09.921339 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:09.921600 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:09.921604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:09.921783 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:09.921982 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:09.921986 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.922775 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.922777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:09.923608 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:09.923611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:09.924215 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:09.924217 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:09.924408 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:09.925133 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:09.925144 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:09.927523 (+ 2379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:09.929472 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:09.929479 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:09.929481 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:09.929779 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:09.930058 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:09.930059 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:09.930060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:09.930193 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:09.930511 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:09.930517 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:09.930668 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 07:19:09.930788 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 07:19:09.930984 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":117,"threads_started":1}
I20260811 07:19:09.931962 31907 heartbeater.cc:347] Connected to a master server at 127.9.142.190:44731
I20260811 07:19:09.932060 31907 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:09.932245 31907 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
W20260811 07:19:09.932941 31907 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:44731 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:19:09.933015 31907 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:09.933079 31907 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
I20260811 07:19:09.933488 31907 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:09.933563 31907 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
W20260811 07:19:09.933909 31907 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:19:10.051584 31914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:10.051985 31914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:10.052088 31914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:10.053790 31914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:10.053855 31914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:10.053900 31914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:19:10.056051 31914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:44219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.142.148:45243/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:42357
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=41403
--tserver_master_addrs=127.9.142.190:44731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:10.056298 31914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:10.056653 31914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:10.062134 31925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:10.062234 31922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:10.062129 31923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:10.062636 31914 server_base.cc:1034] running on GCE node
I20260811 07:19:10.062911 31914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:10.063246 31914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:10.064508 31914 hybrid_clock.cc:648] HybridClock initialized: now 1786432750064475 us; error 46 us; skew 500 ppm
Aug 11 07:19:10 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432750, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:10.067710 31914 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:19:10.068156 31914 webserver.cc:460] Webserver started at http://127.9.142.131:41403/ using document root <none> and password file <none>
I20260811 07:19:10.068390 31914 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:10.068478 31914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:19:10 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432750, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:10.085803 31914 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 07:19:10.095400 31940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:10.095634 31914 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.000s sys 0.000s
I20260811 07:19:10.095763 31914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e"
format_stamp: "Formatted at 2026-08-11 07:19:09 on dist-test-slave-7f01"
server_key: "a3653850381777dd21c766f2fbb05c09"
server_key_iv: "deb920ee97a478f0c39603ccfcfb318c"
server_key_version: "kuduclusterkey@0"
I20260811 07:19:10.096179 31914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:10.119180 31914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:10.121565 31914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:10.121730 31914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:10.122015 31914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:10.122438 31914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:10.122526 31914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:10.122579 31914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:10.122611 31914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:10.129789 31914 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:42357
I20260811 07:19:10.130319 31914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:19:10.134439 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 31914
I20260811 07:19:10.131429 32131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:42357 every 8 connection(s)
Aug 11 07:19:10 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432750, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:10.141503 31686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:10.131457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:57063 (local address 127.9.142.190:44731)
0811 07:19:10.131521 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:10.131523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:10.131776 (+ 253us) server_negotiation.cc:407] Connection header received
0811 07:19:10.132468 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:10.132470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:10.132486 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:10.132570 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:10.133289 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:10.134065 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:10.135600 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:10.135918 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:10.136014 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:10.138274 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:10.138275 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:10.138276 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:10.138282 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:10.140018 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:10.140482 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:10.140483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:10.140483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:10.140545 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:10.140806 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:10.140807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:10.140807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:10.140921 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:10.140998 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:10.141313 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 07:19:10.141397 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:19:10.142032 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:10.131137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:44731 (local address 127.9.142.131:57063)
0811 07:19:10.131606 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:10.131654 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:10.132332 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:10.132647 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:10.132651 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:10.132886 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:10.133169 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:10.133175 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:10.134190 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:10.134191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:10.135497 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:10.135501 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:10.136047 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:10.136049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:10.136188 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:10.136717 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:10.136727 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:10.138180 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:10.140092 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:10.140098 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:10.140100 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:10.140378 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:10.140621 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:10.140622 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:10.140622 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:10.140735 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:10.140993 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:10.140999 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:10.141135 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 07:19:10.141617 (+ 482us) client_negotiation.cc:240] Negotiation successful
0811 07:19:10.141777 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":104,"threads_started":1}
I20260811 07:19:10.142807 32132 heartbeater.cc:347] Connected to a master server at 127.9.142.190:44731
I20260811 07:19:10.142910 32132 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:10.143121 32132 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
W20260811 07:19:10.143869 32132 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:44731 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:19:10.143939 32132 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:10.144006 32132 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
I20260811 07:19:10.144367 32132 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:10.144439 32132 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
W20260811 07:19:10.144788 32132 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:19:10.148447 32139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:10.135809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43926 (local address 127.9.142.190:44731)
0811 07:19:10.136286 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:10.136288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:10.136659 (+ 371us) server_negotiation.cc:407] Connection header received
0811 07:19:10.136682 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:10.136682 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:10.136692 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:10.136783 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:10.137415 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:10.138540 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:10.139494 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:10.139690 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:10.139813 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:10.141190 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:10.141192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:10.141192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:10.141198 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:10.143066 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:10.143598 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:10.143599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:10.143599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:10.143667 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:10.147846 (+ 4179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:10.147848 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:10.147848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:10.148001 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:10.148206 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:10.148253 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 07:19:10.148344 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":76,"threads_started":1}
Aug 11 07:19:10 dist-test-slave-7f01 krb5kdc[29716](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786432750, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:10.729089 31678 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:10.729274 31678 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
I20260811 07:19:10.729712 31364 ts_manager.cc:194] Registered new tserver with Master: 5b422563f8354a75a4f38ecfa420c86b (127.9.142.129:43241)
I20260811 07:19:10.730428 31364 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:46825
I20260811 07:19:10.934108 31907 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:10.934276 31907 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
I20260811 07:19:10.934587 31364 ts_manager.cc:194] Registered new tserver with Master: ba4f3d0bd68945c49a995c697cce516b (127.9.142.130:34879)
I20260811 07:19:10.935189 31364 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:57999
Aug 11 07:19:11 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432750, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:11.144968 32132 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:11.145115 32132 heartbeater.cc:511] Master 127.9.142.190:44731 requested a full tablet report, sending...
I20260811 07:19:11.145471 31364 ts_manager.cc:194] Registered new tserver with Master: 1bc88d4a336441eaaa05b1e2d4ed6d7e (127.9.142.131:42357)
I20260811 07:19:11.146023 31364 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:57063
I20260811 07:19:11.153527 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:19:11.163579 32168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.154906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43934 (local address 127.9.142.190:44731)
0811 07:19:11.155371 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:11.155374 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:11.155381 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:19:11.155405 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:11.155405 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:11.155418 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:11.156237 (+ 819us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:11.156278 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.157029 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.158052 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.158362 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.159985 (+ 1623us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.160035 (+ 50us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:11.160036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:11.160036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:11.160041 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:11.161991 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:11.162414 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:11.162416 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:11.162416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:11.162482 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:11.162697 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:11.162697 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:11.162698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:11.162840 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:11.163366 (+ 526us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:11.163409 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 07:19:11.163490 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":70,"threads_started":1}
I20260811 07:19:11.165979 31364 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:19:11.168382 31364 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:19:11.178499 32176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.172533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:43241 (local address 127.0.0.1:57850)
0811 07:19:11.173434 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:11.173473 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:11.173542 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:11.174111 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:11.174114 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:11.174116 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:11.174188 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.174190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.175468 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.175469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.176987 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.176990 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.178197 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.178198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.178278 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.178295 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 07:19:11.178372 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 07:19:11.178425 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":871,"thread_start_us":80,"threads_started":1}
I20260811 07:19:11.179049 32179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.172869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57850 (local address 127.9.142.129:43241)
0811 07:19:11.173012 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:11.173018 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:11.173881 (+ 863us) server_negotiation.cc:407] Connection header received
0811 07:19:11.173924 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:11.173926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:11.173942 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:11.174015 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:11.174279 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.175377 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.177093 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.178008 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.178084 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.178149 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:11.178929 (+ 780us) server_negotiation.cc:299] Negotiation successful
0811 07:19:11.178972 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":52,"threads_started":1}
I20260811 07:19:11.179922 31572 tablet_service.cc:1467] Processing CreateTablet for tablet 8ea22f7380734c60ab26eddd8c5d3b63 (DEFAULT_TABLE table=test-table [id=45f78fb9cee94e6486cb48940b7574ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:11.180349 31572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ea22f7380734c60ab26eddd8c5d3b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:11.181598 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.172534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:42357 (local address 127.0.0.1:58752)
0811 07:19:11.173638 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:11.173646 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:11.173684 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:11.176059 (+ 2375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:11.176060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:11.176062 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:11.176121 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.176123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.179361 (+ 3238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.179362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.180449 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.180452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.181377 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.181378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.181450 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.181454 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:11.181497 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 07:19:11.181533 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1091,"mutex_wait_us":2,"thread_start_us":75,"threads_started":1}
I20260811 07:19:11.181842 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.172961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58752 (local address 127.9.142.131:42357)
0811 07:19:11.175816 (+ 2855us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:11.175821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:11.175832 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:19:11.175867 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:11.175869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:11.175886 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:11.175972 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:11.176202 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.177238 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.180549 (+ 3311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.181220 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.181284 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.181344 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:11.181733 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 07:19:11.181773 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2820,"thread_start_us":87,"threads_started":1}
I20260811 07:19:11.182430 31996 tablet_service.cc:1467] Processing CreateTablet for tablet 8ea22f7380734c60ab26eddd8c5d3b63 (DEFAULT_TABLE table=test-table [id=45f78fb9cee94e6486cb48940b7574ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:11.182754 31996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ea22f7380734c60ab26eddd8c5d3b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:11.183154 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.172762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:34879 (local address 127.0.0.1:52998)
0811 07:19:11.173753 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:11.173761 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:11.173807 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:11.179600 (+ 5793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:11.179601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:11.179603 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:11.179656 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.179657 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.180909 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.180910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.181961 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.181964 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.182946 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.182947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.183017 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.183021 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:11.183053 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 07:19:11.183088 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":979,"thread_start_us":84,"threads_started":1}
I20260811 07:19:11.183528 32182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.173198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52998 (local address 127.9.142.130:34879)
0811 07:19:11.179431 (+ 6233us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:11.179435 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:11.179444 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:19:11.179478 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:11.179480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:11.179497 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:11.179727 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:11.179837 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.180804 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.182070 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.182832 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.183270 (+ 438us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.183342 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:11.183371 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 07:19:11.183427 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6194,"thread_start_us":55,"threads_started":1}
I20260811 07:19:11.184240 31760 tablet_service.cc:1467] Processing CreateTablet for tablet 8ea22f7380734c60ab26eddd8c5d3b63 (DEFAULT_TABLE table=test-table [id=45f78fb9cee94e6486cb48940b7574ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:11.184578 31760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ea22f7380734c60ab26eddd8c5d3b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:11.188212 32186 tablet_bootstrap.cc:492] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: Bootstrap starting.
I20260811 07:19:11.188884 32186 tablet_bootstrap.cc:654] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:11.189260 32186 log.cc:824] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:11.189648 32187 tablet_bootstrap.cc:492] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: Bootstrap starting.
I20260811 07:19:11.190254 32187 tablet_bootstrap.cc:654] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:11.190614 32187 log.cc:824] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:11.191388 32186 tablet_bootstrap.cc:492] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: No bootstrap required, opened a new log
I20260811 07:19:11.191649 32186 ts_tablet_manager.cc:1397] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:19:11.191888 32185 tablet_bootstrap.cc:492] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b: Bootstrap starting.
I20260811 07:19:11.192577 32185 tablet_bootstrap.cc:654] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:11.192956 32185 log.cc:824] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:11.194108 32186 raft_consensus.cc:348] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } }
I20260811 07:19:11.194358 32186 raft_consensus.cc:374] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:11.194437 32186 raft_consensus.cc:729] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bc88d4a336441eaaa05b1e2d4ed6d7e, State: Initialized, Role: FOLLOWER
I20260811 07:19:11.194614 32186 consensus_queue.cc:260] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } }
I20260811 07:19:11.194932 32186 ts_tablet_manager.cc:1428] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:19:11.195082 32132 heartbeater.cc:503] Master 127.9.142.190:44731 was elected leader, sending a full tablet report...
I20260811 07:19:11.196431 32187 tablet_bootstrap.cc:492] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: No bootstrap required, opened a new log
I20260811 07:19:11.196538 32187 ts_tablet_manager.cc:1397] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260811 07:19:11.198966 32187 raft_consensus.cc:348] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } }
I20260811 07:19:11.199191 32187 raft_consensus.cc:374] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:11.199262 32187 raft_consensus.cc:729] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba4f3d0bd68945c49a995c697cce516b, State: Initialized, Role: FOLLOWER
I20260811 07:19:11.199429 32187 consensus_queue.cc:260] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } }
I20260811 07:19:11.199707 32187 ts_tablet_manager.cc:1428] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:19:11.199880 31907 heartbeater.cc:503] Master 127.9.142.190:44731 was elected leader, sending a full tablet report...
I20260811 07:19:11.200325 32185 tablet_bootstrap.cc:492] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b: No bootstrap required, opened a new log
I20260811 07:19:11.200390 32185 ts_tablet_manager.cc:1397] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260811 07:19:11.202421 32185 raft_consensus.cc:348] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } }
I20260811 07:19:11.202579 32185 raft_consensus.cc:374] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:11.202652 32185 raft_consensus.cc:729] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b422563f8354a75a4f38ecfa420c86b, State: Initialized, Role: FOLLOWER
I20260811 07:19:11.202795 32185 consensus_queue.cc:260] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } }
I20260811 07:19:11.203088 32185 ts_tablet_manager.cc:1428] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:19:11.203202 31678 heartbeater.cc:503] Master 127.9.142.190:44731 was elected leader, sending a full tablet report...
Aug 11 07:19:11 dist-test-slave-7f01 krb5kdc[29716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432750, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for HTTP/127.9.142.148@KRBTEST.COM
I20260811 07:19:11.329525 32195 raft_consensus.cc:482] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:11.329694 32195 raft_consensus.cc:504] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } }
I20260811 07:19:11.330156 32195 leader_election.cc:288] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bc88d4a336441eaaa05b1e2d4ed6d7e (127.9.142.131:42357), ba4f3d0bd68945c49a995c697cce516b (127.9.142.130:34879)
I20260811 07:19:11.335119 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.331146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:53141 (local address 127.9.142.131:42357)
0811 07:19:11.331197 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:11.331199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:11.331405 (+ 206us) server_negotiation.cc:407] Connection header received
0811 07:19:11.331512 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:11.331514 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:11.331524 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:11.331554 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:11.331854 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.332551 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.334057 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.334621 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.334673 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.334683 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:11.334997 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 07:19:11.335045 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:19:11.335649 32201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.330949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:42357 (local address 127.9.142.129:53141)
0811 07:19:11.331335 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:11.331346 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:11.331434 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:11.331623 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:11.331623 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:11.331625 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:11.331719 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.331721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.332656 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.332657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.333944 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.333948 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.334823 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.334825 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.334897 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.334901 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:11.335433 (+ 532us) client_negotiation.cc:240] Negotiation successful
0811 07:19:11.335478 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":90,"threads_started":1}
I20260811 07:19:11.335848 32182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.330788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:39835 (local address 127.9.142.130:34879)
0811 07:19:11.330870 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:11.330872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:11.330880 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:19:11.330911 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:11.330912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:11.330922 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:11.330971 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:11.331232 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.331991 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.334873 (+ 2882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.335416 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.335467 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.335475 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:11.335692 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 07:19:11.335757 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:19:11.336174 32058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea22f7380734c60ab26eddd8c5d3b63" candidate_uuid: "5b422563f8354a75a4f38ecfa420c86b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" is_pre_election: true
I20260811 07:19:11.336339 32058 raft_consensus.cc:2454] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b422563f8354a75a4f38ecfa420c86b in term 0.
I20260811 07:19:11.336643 31501 leader_election.cc:302] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bc88d4a336441eaaa05b1e2d4ed6d7e, 5b422563f8354a75a4f38ecfa420c86b; no voters:
I20260811 07:19:11.336773 32195 raft_consensus.cc:2781] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:19:11.336833 32195 raft_consensus.cc:482] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:19:11.336860 32195 raft_consensus.cc:3037] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:11.337297 32199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.330437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:34879 (local address 127.9.142.129:39835)
0811 07:19:11.330640 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:11.330654 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:11.330712 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:11.331032 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:11.331033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:11.331036 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:11.331149 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.331151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.333072 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.333073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.334156 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:11.334746 (+ 590us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.335539 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.335539 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:11.335610 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.335613 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:19:11.337170 (+ 1557us) client_negotiation.cc:240] Negotiation successful
0811 07:19:11.337217 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":113,"threads_started":1}
I20260811 07:19:11.337782 32195 raft_consensus.cc:504] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } }
I20260811 07:19:11.337920 32195 leader_election.cc:288] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [CANDIDATE]: Term 1 election: Requested vote from peers 1bc88d4a336441eaaa05b1e2d4ed6d7e (127.9.142.131:42357), ba4f3d0bd68945c49a995c697cce516b (127.9.142.130:34879)
I20260811 07:19:11.338279 31830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea22f7380734c60ab26eddd8c5d3b63" candidate_uuid: "5b422563f8354a75a4f38ecfa420c86b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba4f3d0bd68945c49a995c697cce516b" is_pre_election: true
I20260811 07:19:11.338438 31830 raft_consensus.cc:2454] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b422563f8354a75a4f38ecfa420c86b in term 0.
I20260811 07:19:11.338549 31828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea22f7380734c60ab26eddd8c5d3b63" candidate_uuid: "5b422563f8354a75a4f38ecfa420c86b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba4f3d0bd68945c49a995c697cce516b"
I20260811 07:19:11.338606 31828 raft_consensus.cc:3037] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:11.339437 31828 raft_consensus.cc:2454] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b422563f8354a75a4f38ecfa420c86b in term 1.
I20260811 07:19:11.339699 31498 leader_election.cc:302] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b422563f8354a75a4f38ecfa420c86b, ba4f3d0bd68945c49a995c697cce516b; no voters:
I20260811 07:19:11.340257 32058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ea22f7380734c60ab26eddd8c5d3b63" candidate_uuid: "5b422563f8354a75a4f38ecfa420c86b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e"
I20260811 07:19:11.340337 32058 raft_consensus.cc:3037] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:11.341190 32058 raft_consensus.cc:2454] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b422563f8354a75a4f38ecfa420c86b in term 1.
I20260811 07:19:11.341454 32195 raft_consensus.cc:2781] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:11.341598 32195 raft_consensus.cc:686] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [term 1 LEADER]: Becoming Leader. State: Replica: 5b422563f8354a75a4f38ecfa420c86b, State: Running, Role: LEADER
I20260811 07:19:11.341686 32195 consensus_queue.cc:237] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } }
I20260811 07:19:11.342664 31364 catalog_manager.cc:5495] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b422563f8354a75a4f38ecfa420c86b (127.9.142.129). New cstate: current_term: 1 leader_uuid: "5b422563f8354a75a4f38ecfa420c86b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b422563f8354a75a4f38ecfa420c86b" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260811 07:19:11.363927 32179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.360529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57856 (local address 127.9.142.129:43241)
0811 07:19:11.360577 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:11.360579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:11.360588 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:19:11.360626 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:11.360626 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:11.360645 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:11.360718 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:19:11.360927 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.361670 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.362795 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:11.363108 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:11.363171 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:11.363366 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:19:11.363494 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:19:11.363567 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:11.363835 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 07:19:11.363854 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 07:19:11.368741 31828 raft_consensus.cc:1261] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [term 1 FOLLOWER]: Refusing update from remote peer 5b422563f8354a75a4f38ecfa420c86b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:11.369182 32202 consensus_queue.cc:1035] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba4f3d0bd68945c49a995c697cce516b" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:11.371414 32058 raft_consensus.cc:1261] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [term 1 FOLLOWER]: Refusing update from remote peer 5b422563f8354a75a4f38ecfa420c86b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:11.371726 32202 consensus_queue.cc:1035] T 8ea22f7380734c60ab26eddd8c5d3b63 P 5b422563f8354a75a4f38ecfa420c86b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bc88d4a336441eaaa05b1e2d4ed6d7e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:11.375043 32211 mvcc.cc:205] Tried to move back new op lower bound from 7317228549603741696 to 7317228549496217600. Current Snapshot: MvccSnapshot[applied={T|T < 7317228549603741696}]
I20260811 07:19:11.375651 32216 mvcc.cc:205] Tried to move back new op lower bound from 7317228549603741696 to 7317228549496217600. Current Snapshot: MvccSnapshot[applied={T|T < 7317228549603741696}]
I20260811 07:19:11.378214 32212 mvcc.cc:205] Tried to move back new op lower bound from 7317228549603741696 to 7317228549496217600. Current Snapshot: MvccSnapshot[applied={T|T < 7317228549603741696}]
I20260811 07:19:11.379765 31364 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:11.379863 31364 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:11.380633 31364 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 26edf640300b426ea5e411fa2ad1a749: Sending DeleteTablet for 3 replicas of tablet 8ea22f7380734c60ab26eddd8c5d3b63
I20260811 07:19:11.381070 31572 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ea22f7380734c60ab26eddd8c5d3b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:11 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:57850
I20260811 07:19:11.381265 31996 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ea22f7380734c60ab26eddd8c5d3b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:11 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:58752
I20260811 07:19:11.381691 31760 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ea22f7380734c60ab26eddd8c5d3b63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:11 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:52998
I20260811 07:19:11.382206 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 31423
I20260811 07:19:11.399194 32228 tablet_replica.cc:330] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: stopping tablet replica
I20260811 07:19:11.403820 32228 raft_consensus.cc:2229] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:11.404120 32228 raft_consensus.cc:2258] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:11.404289 32227 tablet_replica.cc:330] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: stopping tablet replica
I20260811 07:19:11.409943 32227 raft_consensus.cc:2229] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:11.410380 32227 raft_consensus.cc:2258] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:11.410900 32228 ts_tablet_manager.cc:1905] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:11.412832 32228 ts_tablet_manager.cc:1918] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:11.413313 32227 ts_tablet_manager.cc:1905] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:11.414954 32227 ts_tablet_manager.cc:1918] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:11.415098 32227 log.cc:1196] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/8ea22f7380734c60ab26eddd8c5d3b63
I20260811 07:19:11.415197 32228 log.cc:1196] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/8ea22f7380734c60ab26eddd8c5d3b63
I20260811 07:19:11.415598 32227 ts_tablet_manager.cc:1939] T 8ea22f7380734c60ab26eddd8c5d3b63 P 1bc88d4a336441eaaa05b1e2d4ed6d7e: Deleting consensus metadata
I20260811 07:19:11.415973 32228 ts_tablet_manager.cc:1939] T 8ea22f7380734c60ab26eddd8c5d3b63 P ba4f3d0bd68945c49a995c697cce516b: Deleting consensus metadata
I20260811 07:19:11.416488 31346 catalog_manager.cc:4841] TS 1bc88d4a336441eaaa05b1e2d4ed6d7e (127.9.142.131:42357): tablet 8ea22f7380734c60ab26eddd8c5d3b63 (table test-table [id=45f78fb9cee94e6486cb48940b7574ce]) successfully deleted
I20260811 07:19:11.417063 31338 catalog_manager.cc:4841] TS ba4f3d0bd68945c49a995c697cce516b (127.9.142.130:34879): tablet 8ea22f7380734c60ab26eddd8c5d3b63 (table test-table [id=45f78fb9cee94e6486cb48940b7574ce]) successfully deleted
W20260811 07:19:11.417606 31343 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:43241 (error 108)
I20260811 07:19:11.418527 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 31687
I20260811 07:19:11.418533 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:11.418384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:43241 (local address 127.0.0.1:57868)
0811 07:19:11.418438 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:11.418494 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:43241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 07:19:11.451575 31343 catalog_manager.cc:4584] TS 5b422563f8354a75a4f38ecfa420c86b (127.9.142.129:43241): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8ea22f7380734c60ab26eddd8c5d3b63: Network error: Client connection negotiation failed: client connection to 127.9.142.129:43241: connect: Connection refused (error 111)
I20260811 07:19:11.456699 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 31914
I20260811 07:19:11.466361 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 31311
I20260811 07:19:11.480626 9786 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 07:19:11.825878 9786 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 07:19:11.825974 9786 mini_ranger.cc:66] Stopping Ranger...
I20260811 07:19:12.180454 9786 mini_ranger.cc:68] Stopped Ranger
2026-08-11 07:19:12.180 UTC [29770] LOG: received smart shutdown request
2026-08-11 07:19:12.184 UTC [29770] LOG: background worker "logical replication launcher" (PID 29780) exited with exit code 1
2026-08-11 07:19:12.185 UTC [29774] LOG: shutting down
2026-08-11 07:19:12.355 UTC [29770] LOG: database system is shut down
2026-08-11T07:19:12Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49449 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:19:12 dist-test-slave-7f01 krb5kdc[32243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:19:12 dist-test-slave-7f01 krb5kdc[32243](info): set up 2 sockets
Aug 11 07:19:12 dist-test-slave-7f01 krb5kdc[32243](info): commencing operation
krb5kdc: starting...
W20260811 07:19:13.743075 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:19:13 dist-test-slave-7f01 krb5kdc[32243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:19:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:19:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:19:13.866084 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45451
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:45451,127.9.142.189:35213,127.9.142.188:43753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:13.949805 32260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:13.950006 32260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:13.950027 32260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:13.951144 32260 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:13.951187 32260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:13.951201 32260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:13.951215 32260 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:13.951226 32260 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:13.952661 32260 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:45451,127.9.142.189:35213,127.9.142.188:43753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:13.952843 32260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:13.953015 32260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:13.957763 32268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:13.957792 32260 server_base.cc:1034] running on GCE node
W20260811 07:19:13.957810 32269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:13.957873 32272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:13.958345 32260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:13.958719 32260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:13.959926 32260 hybrid_clock.cc:648] HybridClock initialized: now 1786432753959906 us; error 37 us; skew 500 ppm
Aug 11 07:19:13 dist-test-slave-7f01 krb5kdc[32243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432753, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:13.962361 32260 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:19:13.962834 32260 webserver.cc:460] Webserver started at http://127.9.142.190:33935/ using document root <none> and password file <none>
I20260811 07:19:13.963080 32260 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:13.963125 32260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:13.963296 32260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:13.964395 32260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "fadd84384e3d4214b119032273806dce"
format_stamp: "Formatted at 2026-08-11 07:19:13 on dist-test-slave-7f01"
server_key: "249dbacf3bb0b85e67383383f8e17a3e"
server_key_iv: "872fb649bd1bf5402fb9628faee25468"
server_key_version: "encryptionkey@0"
I20260811 07:19:13.964792 32260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "fadd84384e3d4214b119032273806dce"
format_stamp: "Formatted at 2026-08-11 07:19:13 on dist-test-slave-7f01"
server_key: "249dbacf3bb0b85e67383383f8e17a3e"
server_key_iv: "872fb649bd1bf5402fb9628faee25468"
server_key_version: "encryptionkey@0"
I20260811 07:19:13.966125 32260 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:19:13.966835 32282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:13.967016 32260 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:19:13.967113 32260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "fadd84384e3d4214b119032273806dce"
format_stamp: "Formatted at 2026-08-11 07:19:13 on dist-test-slave-7f01"
server_key: "249dbacf3bb0b85e67383383f8e17a3e"
server_key_iv: "872fb649bd1bf5402fb9628faee25468"
server_key_version: "encryptionkey@0"
I20260811 07:19:13.967185 32260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:13.981092 32260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:13.982952 32260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:13.983105 32260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:13.987316 32260 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:45451
I20260811 07:19:13.987406 32366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:45451 every 8 connection(s)
I20260811 07:19:13.987854 32260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:19:13.988725 32369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:13.990275 32369 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:19:13.990849 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 32260
I20260811 07:19:13.990969 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:19:13.991204 9786 external_mini_cluster.cc:1428] Setting key 0eb790e5119a92744d1219a9d2cb5014
Aug 11 07:19:13 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432753, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.142.189@KRBTEST.COM; defaulting to no policy
I20260811 07:19:14.001634 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:13.991007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45451 (local address 127.0.0.1:40410)
0811 07:19:13.991258 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:13.991296 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:13.991812 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:13.992154 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:13.992157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:13.992400 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:13.992551 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:13.992554 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:13.993864 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:13.993865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:13.994909 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:13.994912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:13.995606 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:13.995607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:13.995663 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:13.996248 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:13.996256 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:13.997880 (+ 1624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:14.000044 (+ 2164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.000051 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.000053 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.000249 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.000543 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.000544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.000544 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.000633 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.001095 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:14.001101 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:14.001158 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 07:19:14.001238 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:19:14.001370 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":93,"threads_started":1}
I20260811 07:19:14.001644 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:13.991031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40410 (local address 127.9.142.190:45451)
0811 07:19:13.991207 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:13.991217 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:13.991407 (+ 190us) server_negotiation.cc:407] Connection header received
0811 07:19:13.992001 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:13.992003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:13.992025 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:13.992123 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:13.992656 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:13.993762 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:13.995000 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:13.995518 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:13.995628 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:13.998023 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:13.998033 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:13.998033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:13.998041 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:13.999953 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.000338 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.000341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.000342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.000463 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.000711 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.000712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.000713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.001018 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.001116 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.001298 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.001467 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260811 07:19:14.002543 32369 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:19:14.002864 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.002753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:35213 (local address 127.0.0.1:47484)
0811 07:19:14.002797 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.002845 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 07:19:14.003038 32284 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
I20260811 07:19:14.003437 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.003354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:35213 (local address 127.0.0.1:47486)
0811 07:19:14.003393 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.003419 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 07:19:14.003675 32369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.189:35213: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab.
Entry for principal kudu/127.9.142.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab.
I20260811 07:19:14.019191 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.189:35213
--webserver_interface=127.9.142.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab
--principal=kudu/127.9.142.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:45451,127.9.142.189:35213,127.9.142.188:43753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:19:14.052933 32369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } attempt: 1
I20260811 07:19:14.053431 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.053299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:35213 (local address 127.0.0.1:47488)
0811 07:19:14.053361 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.053401 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 07:19:14.053813 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.053719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:35213 (local address 127.0.0.1:47504)
0811 07:19:14.053763 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.053788 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 07:19:14.053920 32369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.189:35213: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
W20260811 07:19:14.102346 32377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:14.102550 32377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:14.102574 32377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:14.103785 32377 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:14.103824 32377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:14.103838 32377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:14.103852 32377 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:14.103904 32377 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:14.105394 32377 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:45451,127.9.142.189:35213,127.9.142.188:43753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab
--principal=kudu/127.9.142.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.189:35213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.142.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:14.105656 32377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:14.105876 32377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:14.110597 32388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:14.110616 32382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:14.110620 32385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:14.110872 32377 server_base.cc:1034] running on GCE node
I20260811 07:19:14.111160 32377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:14.111441 32377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:14.112635 32377 hybrid_clock.cc:648] HybridClock initialized: now 1786432754112594 us; error 56 us; skew 500 ppm
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432754, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:14.115068 32377 init.cc:377] Logged in from keytab as kudu/127.9.142.189@KRBTEST.COM (short username kudu)
I20260811 07:19:14.115545 32377 webserver.cc:460] Webserver started at http://127.9.142.189:45527/ using document root <none> and password file <none>
I20260811 07:19:14.115837 32377 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:14.115906 32377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:14.116050 32377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:14.117120 32377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/data/instance:
uuid: "18f2d90e06794c64b230249e14da48fd"
format_stamp: "Formatted at 2026-08-11 07:19:14 on dist-test-slave-7f01"
server_key: "17388008c68800935cc7ef0e21d671ea"
server_key_iv: "d9085b80e783e420d3e774e48c797157"
server_key_version: "encryptionkey@0"
I20260811 07:19:14.117529 32377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/wal/instance:
uuid: "18f2d90e06794c64b230249e14da48fd"
format_stamp: "Formatted at 2026-08-11 07:19:14 on dist-test-slave-7f01"
server_key: "17388008c68800935cc7ef0e21d671ea"
server_key_iv: "d9085b80e783e420d3e774e48c797157"
server_key_version: "encryptionkey@0"
I20260811 07:19:14.118938 32377 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:19:14.119643 32402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:14.119858 32377 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:19:14.119980 32377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/wal
uuid: "18f2d90e06794c64b230249e14da48fd"
format_stamp: "Formatted at 2026-08-11 07:19:14 on dist-test-slave-7f01"
server_key: "17388008c68800935cc7ef0e21d671ea"
server_key_iv: "d9085b80e783e420d3e774e48c797157"
server_key_version: "encryptionkey@0"
I20260811 07:19:14.120057 32377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:14.122087 32369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } attempt: 2
I20260811 07:19:14.122470 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.122335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:35213 (local address 127.0.0.1:47510)
0811 07:19:14.122394 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.122436 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 07:19:14.122769 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.122681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:35213 (local address 127.0.0.1:47520)
0811 07:19:14.122725 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.122748 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 07:19:14.122860 32369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.189:35213: Network error: Client connection negotiation failed: client connection to 127.9.142.189:35213: connect: Connection refused (error 111)
I20260811 07:19:14.142293 32377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:14.144140 32377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:14.144300 32377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:14.148430 32377 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.189:35213
I20260811 07:19:14.148464 32478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.189:35213 every 8 connection(s)
I20260811 07:19:14.148803 32377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
I20260811 07:19:14.149632 32480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:14.151175 32480 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:19:14.154157 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 32377
I20260811 07:19:14.154277 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-1/wal/instance
I20260811 07:19:14.154482 9786 external_mini_cluster.cc:1428] Setting key 3d12aa22eca22ab976edc5240bfc5bc0
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432754, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:14.161175 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.151862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45451 (local address 127.0.0.1:40416)
0811 07:19:14.152005 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.152039 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:14.152515 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:14.152770 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:14.152774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:14.153004 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:14.153197 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.153201 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.153902 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.153903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.155174 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.155178 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.155605 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.155606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.155814 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.156265 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:14.156276 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:14.157711 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:14.159710 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.159717 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.159719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.160017 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.160257 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.160258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.160258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.160373 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.160707 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:14.160712 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:14.160841 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 07:19:14.160916 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 07:19:14.161029 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
I20260811 07:19:14.161226 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.151852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40416 (local address 127.9.142.190:45451)
0811 07:19:14.151909 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.151911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.152121 (+ 210us) server_negotiation.cc:407] Connection header received
0811 07:19:14.152630 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.152632 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.152645 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.152695 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.153317 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.153804 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.155272 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.155512 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.155575 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.157826 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.157827 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.157828 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.157836 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.159619 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.160097 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.160099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.160100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.160171 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.160463 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.160465 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.160465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.160636 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.160714 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.160997 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.161093 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 07:19:14.161895 32480 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.9.142.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.188@KRBTEST.COM" created.
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432754, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
I20260811 07:19:14.170887 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.162196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:35213 (local address 127.0.0.1:47526)
0811 07:19:14.162401 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.162412 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:14.162471 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:14.162608 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:14.162609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:14.162769 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:14.162835 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.162837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.163703 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.163704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.164567 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.164570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.165027 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.165028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.165085 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.165488 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:14.165492 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:14.167761 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:14.169784 (+ 2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.169785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.169785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.169991 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.170225 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.170226 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.170226 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.170284 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.170561 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:14.170561 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:14.170600 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 07:19:14.170689 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 07:19:14.170786 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190}
I20260811 07:19:14.171015 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.162265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47526 (local address 127.9.142.189:35213)
0811 07:19:14.162417 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.162420 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.162464 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:19:14.162530 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.162531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.162542 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.162604 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.162912 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.163605 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.164653 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.164955 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.165015 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.167851 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.167858 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.167859 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.167864 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.169693 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.170090 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.170093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.170094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.170154 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.170357 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.170358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.170358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.170488 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.170579 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.170722 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.170856 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260811 07:19:14.172001 32480 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:19:14.172327 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.172209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51016)
0811 07:19:14.172257 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.172299 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 07:19:14.172456 32404 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
I20260811 07:19:14.172840 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.172744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51024)
0811 07:19:14.172795 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.172818 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 07:19:14.172953 32480 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43753: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab.
Entry for principal kudu/127.9.142.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab.
I20260811 07:19:14.183044 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.188:43753
--webserver_interface=127.9.142.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab
--principal=kudu/127.9.142.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:45451,127.9.142.189:35213,127.9.142.188:43753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:19:14.214001 32369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } attempt: 3
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432753, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
I20260811 07:19:14.221228 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.214357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:35213 (local address 127.0.0.1:47532)
0811 07:19:14.214411 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.214429 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:14.214503 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:14.214668 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:14.214669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:14.214833 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:14.214903 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.214904 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.215578 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.215580 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.216152 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.216154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.216544 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.216545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.216638 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.217118 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:14.217122 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:14.218492 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:14.220170 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.220171 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.220172 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.220348 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.220574 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.220575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.220575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.220640 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.220890 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:14.220891 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:14.220939 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 07:19:14.221027 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:19:14.221130 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 07:19:14.221228 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.214425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47532 (local address 127.9.142.189:35213)
0811 07:19:14.214496 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.214498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.214509 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:19:14.214570 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.214571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.214590 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.214648 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.214994 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.215492 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.216242 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.216454 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.216536 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.218581 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.218582 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.218583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.218590 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.220085 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.220442 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.220443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.220444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.220505 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.220707 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.220708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.220708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.220821 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.220898 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.221053 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.221130 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 07:19:14.221701 32369 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:19:14.222060 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.221963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51038)
0811 07:19:14.222011 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.222041 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 07:19:14.222153 32480 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } attempt: 1
I20260811 07:19:14.222393 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.222306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51048)
0811 07:19:14.222339 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.222368 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 07:19:14.222468 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.222374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51052)
0811 07:19:14.222415 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.222437 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 07:19:14.222502 32369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43753: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
I20260811 07:19:14.222790 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.222695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51054)
0811 07:19:14.222738 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.222761 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 07:19:14.222879 32480 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43753: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
I20260811 07:19:14.253640 32369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } attempt: 1
I20260811 07:19:14.254033 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.253906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51070)
0811 07:19:14.253976 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.254007 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 07:19:14.254377 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.254284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51084)
0811 07:19:14.254328 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.254354 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 07:19:14.254468 32369 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43753: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
W20260811 07:19:14.268543 32490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:14.268723 32490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:14.268745 32490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:14.269932 32490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:14.269974 32490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:14.269989 32490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:14.270033 32490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:14.270052 32490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:14.271605 32490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:45451,127.9.142.189:35213,127.9.142.188:43753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab
--principal=kudu/127.9.142.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.188:43753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.142.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:14.271872 32490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:14.272107 32490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:14.276849 32497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:14.276850 32498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:14.276979 32490 server_base.cc:1034] running on GCE node
W20260811 07:19:14.276849 32500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:14.277311 32490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:14.277644 32490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:14.278815 32490 hybrid_clock.cc:648] HybridClock initialized: now 1786432754278797 us; error 28 us; skew 500 ppm
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432754, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:14.281333 32490 init.cc:377] Logged in from keytab as kudu/127.9.142.188@KRBTEST.COM (short username kudu)
I20260811 07:19:14.281746 32490 webserver.cc:460] Webserver started at http://127.9.142.188:46221/ using document root <none> and password file <none>
I20260811 07:19:14.281965 32490 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:14.282035 32490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:14.282183 32490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:14.283174 32490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/data/instance:
uuid: "d5e00935e7b74f848b2eb20644a0798e"
format_stamp: "Formatted at 2026-08-11 07:19:14 on dist-test-slave-7f01"
server_key: "516b7eae964a558fbe6b25373ea18319"
server_key_iv: "ab5e06fafcf3508046f388e8443c2e09"
server_key_version: "encryptionkey@0"
I20260811 07:19:14.283531 32490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/wal/instance:
uuid: "d5e00935e7b74f848b2eb20644a0798e"
format_stamp: "Formatted at 2026-08-11 07:19:14 on dist-test-slave-7f01"
server_key: "516b7eae964a558fbe6b25373ea18319"
server_key_iv: "ab5e06fafcf3508046f388e8443c2e09"
server_key_version: "encryptionkey@0"
I20260811 07:19:14.284889 32490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:14.285573 32514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:14.285754 32490 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:14.285856 32490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/wal
uuid: "d5e00935e7b74f848b2eb20644a0798e"
format_stamp: "Formatted at 2026-08-11 07:19:14 on dist-test-slave-7f01"
server_key: "516b7eae964a558fbe6b25373ea18319"
server_key_iv: "ab5e06fafcf3508046f388e8443c2e09"
server_key_version: "encryptionkey@0"
I20260811 07:19:14.285943 32490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:14.291009 32480 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } attempt: 2
I20260811 07:19:14.291373 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.291253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51098)
0811 07:19:14.291311 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.291347 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 07:19:14.291712 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.291618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51106)
0811 07:19:14.291663 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.291687 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 07:19:14.291860 32480 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43753: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43753: connect: Connection refused (error 111)
I20260811 07:19:14.295841 32490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:14.297533 32490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:14.297640 32490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:14.301680 32490 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.188:43753
I20260811 07:19:14.301745 32593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.188:43753 every 8 connection(s)
I20260811 07:19:14.302058 32490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
I20260811 07:19:14.302930 32596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:14.304545 32596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:19:14.307843 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 32490
I20260811 07:19:14.307960 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786432592145333-9786-0/minicluster-data/master-2/wal/instance
I20260811 07:19:14.308159 9786 external_mini_cluster.cc:1428] Setting key 7b415484bc607fa594410f1d148ba933
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432754, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:19:14.314257 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.305229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40418 (local address 127.9.142.190:45451)
0811 07:19:14.305286 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.305288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.305465 (+ 177us) server_negotiation.cc:407] Connection header received
0811 07:19:14.305897 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.305898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.305907 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.305968 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.306532 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.307010 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.308318 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.308666 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.308750 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.311113 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.311115 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.311115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.311123 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.312835 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.313223 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.313225 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.313225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.313293 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.313581 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.313581 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.313582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.313687 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.313739 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.314074 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.314161 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 07:19:14.314294 32598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.305174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45451 (local address 127.0.0.1:40418)
0811 07:19:14.305335 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.305375 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:14.305820 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:14.306037 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:14.306041 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:14.306278 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:14.306461 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.306465 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.307128 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.307129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.308211 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.308214 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.308812 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.308813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.308959 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.309482 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:14.309490 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:14.311023 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:14.312922 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.312929 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.312930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.313139 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.313375 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.313376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.313376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.313510 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.313757 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:14.313764 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:14.313924 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 07:19:14.314033 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 07:19:14.314145 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260811 07:19:14.315333 32596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:19:14.317420 32601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.308574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51116 (local address 127.9.142.188:43753)
0811 07:19:14.308785 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.308789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.308813 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:19:14.308833 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.308835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.308855 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.308939 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.309641 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.310488 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.311325 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.311822 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.311887 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.314433 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.314457 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.314457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.314463 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.316322 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.316642 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.316645 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.316646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.316711 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.316938 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.316939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.316939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.317072 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.317204 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.317291 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.317352 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":125,"threads_started":1}
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432754, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
I20260811 07:19:14.322528 32598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.315584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:35213 (local address 127.0.0.1:47546)
0811 07:19:14.315641 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.315652 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:14.315691 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:14.315864 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:14.315865 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:14.315995 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:14.316021 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.316022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.316807 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.316808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.317537 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.317541 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.317977 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.317977 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.318021 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.318408 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:14.318414 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:14.319865 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:14.321563 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.321564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.321565 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.321795 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.321995 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.321996 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.321996 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.322060 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.322286 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:14.322287 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:14.322331 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 07:19:14.322403 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 07:19:14.322471 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 07:19:14.322638 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.315681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47546 (local address 127.9.142.189:35213)
0811 07:19:14.315730 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.315732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.315760 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:19:14.315790 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.315792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.315802 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.315860 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.316101 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.316732 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.317623 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.317899 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.317969 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.319968 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.319969 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.319969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.319976 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.321479 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.321876 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.321877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.321877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.321928 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.322123 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.322124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.322124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.322218 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.322288 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.322457 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.322532 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:14.322988 32596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:19:14.326130 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.318252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40434 (local address 127.9.142.190:45451)
0811 07:19:14.318289 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.318290 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.318483 (+ 193us) server_negotiation.cc:407] Connection header received
0811 07:19:14.318539 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.318540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.318548 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.318586 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.319156 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.319841 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.320476 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.320786 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.320851 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.323377 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.323378 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.323379 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.323387 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.325008 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.325338 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.325339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.325339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.325404 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.325587 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.325587 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.325587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.325674 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.325888 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.325931 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.326004 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432754, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:19:14.329609 32369 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } attempt: 2
I20260811 07:19:14.330220 32598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.323221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51122)
0811 07:19:14.323271 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.323283 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:14.323321 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:14.323464 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:14.323465 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:14.323615 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:14.323647 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.323648 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.324550 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.324551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.325247 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.325249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.325723 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.325724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.325775 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.326172 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:14.326177 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:14.327363 (+ 1186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:14.329043 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.329044 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.329044 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.329250 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.329479 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.329480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.329481 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.329544 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.329984 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:14.329984 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:14.330023 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 07:19:14.330084 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 07:19:14.330166 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 07:19:14.330492 32601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.323288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51122 (local address 127.9.142.188:43753)
0811 07:19:14.323324 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.323326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.323352 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:19:14.323391 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.323392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.323402 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.323458 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.323728 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.324468 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.325328 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.325642 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.325698 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.327447 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.327448 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.327449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.327457 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.328944 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.329323 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.329324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.329324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.329395 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.329764 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.329765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.329765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.329896 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.329959 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.330345 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.330410 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
I20260811 07:19:14.331921 32596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e: Bootstrap starting.
I20260811 07:19:14.332880 32596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:14.333137 32596 log.cc:824] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:14.334090 32596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e: No bootstrap required, opened a new log
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432753, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:19:14.334882 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.326745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47558 (local address 127.9.142.189:35213)
0811 07:19:14.326793 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.326795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.326838 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:19:14.326908 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.326909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.326918 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.326965 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.327493 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.328087 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.329042 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.329350 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.329398 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.332028 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.332029 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.332030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.332036 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.333737 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.334082 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.334083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.334084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.334147 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.334347 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.334349 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.334349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.334463 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.334659 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.334697 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.334770 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 07:19:14.336386 32596 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } }
I20260811 07:19:14.336555 32596 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:14.336614 32596 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5e00935e7b74f848b2eb20644a0798e, State: Initialized, Role: FOLLOWER
I20260811 07:19:14.336694 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:19:14.336748 32596 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } }
I20260811 07:19:14.337045 32596 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:19:14.337052 32604 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.337167 32604 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:19:14.338096 32372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.329862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51136)
0811 07:19:14.329926 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.329937 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:14.329988 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:14.330282 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:14.330283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:14.330444 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:14.330482 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.330484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.331692 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.331693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.332477 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.332481 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.333293 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.333294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.333354 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.333750 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:14.333756 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:14.335095 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:14.336996 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.336997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.336997 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.337226 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.337438 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.337439 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.337439 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.337508 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.337785 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:14.337786 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:14.337831 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 07:19:14.337902 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 07:19:14.338004 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 07:19:14.338128 32602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.329961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51136 (local address 127.9.142.188:43753)
0811 07:19:14.330137 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.330139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.330147 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:19:14.330166 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.330167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.330177 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.330254 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.330802 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.331560 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.332567 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.333195 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.333275 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.335194 (+ 1919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.335195 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.335196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.335203 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.336886 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.337300 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.337301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.337301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.337358 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.337588 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.337589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.337589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.337717 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.337779 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.337927 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.338005 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
W20260811 07:19:14.339011 32629 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 07:19:14.339980 32369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce: Bootstrap starting.
W20260811 07:19:14.339138 32629 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:19:14.340677 32369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:14.340965 32369 log.cc:824] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:14.341918 32369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce: No bootstrap required, opened a new log
I20260811 07:19:14.341746 32490 master_runner.cc:186] Error getting master registration for 127.9.142.190:45451: OK, instance_id { permanent_uuid: "fadd84384e3d4214b119032273806dce" instance_seqno: 1786432753986189 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:19:14.344035 32490 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:19:14.344419 32369 raft_consensus.cc:348] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } }
I20260811 07:19:14.344565 32369 raft_consensus.cc:374] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:14.344604 32369 raft_consensus.cc:729] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fadd84384e3d4214b119032273806dce, State: Initialized, Role: FOLLOWER
I20260811 07:19:14.344730 32369 consensus_queue.cc:260] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } }
I20260811 07:19:14.345067 32369 sys_catalog.cc:564] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:19:14.345019 32635 sys_catalog.cc:455] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.345121 32635 sys_catalog.cc:458] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:19:14.345937 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.338347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40444 (local address 127.9.142.190:45451)
0811 07:19:14.338384 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.338386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.338526 (+ 140us) server_negotiation.cc:407] Connection header received
0811 07:19:14.338625 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.338626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.338636 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.338666 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.339409 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.340096 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.341085 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.341362 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.341404 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.342889 (+ 1485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.342890 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.342891 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.342897 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.344574 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.345009 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.345010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.345010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.345069 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.345301 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.345302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.345302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.345420 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.345492 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.345741 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.345825 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 07:19:14.347013 32655 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:19:14.347162 32655 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:19:14.348687 32260 master_runner.cc:186] Error getting master registration for 127.9.142.189:35213: OK, instance_id { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" instance_seqno: 1786432754147205 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:19:14.351541 32260 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:19:14.355521 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.347480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.9.142.189:35213)
0811 07:19:14.347535 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.347538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.347548 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:19:14.347570 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.347571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.347581 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.347636 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.348281 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.348986 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.349942 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.350225 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.350284 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.351678 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.351680 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.351680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.351687 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.354191 (+ 2504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.354575 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.354576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.354576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.354629 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.354809 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.354809 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.354809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.354921 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.355007 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.355340 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.355428 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:19:14.359668 32602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.348043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51138 (local address 127.9.142.188:43753)
0811 07:19:14.348274 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.348276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.351968 (+ 3692us) server_negotiation.cc:407] Connection header received
0811 07:19:14.352041 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.352042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.352053 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.352104 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.352689 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.353466 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.354451 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.354784 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.354828 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.356754 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.356755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.356755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.356762 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.358381 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.358787 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.358788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.358788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.358850 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.359087 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.359088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.359088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.359229 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.359324 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.359491 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.359572 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211}
I20260811 07:19:14.383004 32480 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } attempt: 3
Aug 11 07:19:14 dist-test-slave-7f01 krb5kdc[32243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432754, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:19:14.391532 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.383272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43753 (local address 127.0.0.1:51144)
0811 07:19:14.383324 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:14.383334 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:14.383373 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:14.383523 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:14.383524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:14.383711 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:14.383797 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.383799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.384734 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.384735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.385544 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:14.385547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.386018 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.386019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:14.386080 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.386603 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:14.386609 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:14.388552 (+ 1943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:14.390410 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.390411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.390412 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.390641 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.390858 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:14.390859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:14.390859 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:14.390928 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:14.391202 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:14.391203 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:14.391252 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 07:19:14.391325 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:19:14.391425 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 07:19:14.391547 32602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:14.383326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51144 (local address 127.9.142.188:43753)
0811 07:19:14.383364 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:14.383366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:14.383375 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:19:14.383430 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:14.383430 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:14.383440 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:14.383501 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:14.383877 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.384633 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.385636 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:14.385934 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:14.386007 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:14.388639 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:14.388640 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:14.388641 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:14.388647 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:14.390321 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.390720 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.390722 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.390722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.390785 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:14.390998 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:14.390999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:14.390999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:14.391130 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:14.391200 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:14.391364 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 07:19:14.391454 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:19:14.393486 32480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd: Bootstrap starting.
I20260811 07:19:14.394249 32480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:14.394587 32480 log.cc:824] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:14.395566 32480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd: No bootstrap required, opened a new log
I20260811 07:19:14.397614 32480 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } }
I20260811 07:19:14.397759 32480 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:14.397800 32480 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f2d90e06794c64b230249e14da48fd, State: Initialized, Role: FOLLOWER
I20260811 07:19:14.397974 32480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } }
I20260811 07:19:14.398299 32480 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [sys.catalog]: configured and running, proceeding with master startup.
W20260811 07:19:14.400380 32679 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:19:14.400543 32679 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:19:14.402558 32377 master_runner.cc:263] No leader master found from master 18f2d90e06794c64b230249e14da48fd
I20260811 07:19:14.402613 32377 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:19:14.398258 32661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.402663 32661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:19:14.483870 32291 tablet.cc:2369] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:19:14.525415 32635 raft_consensus.cc:482] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:14.525560 32635 raft_consensus.cc:504] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } }
I20260811 07:19:14.525817 32635 leader_election.cc:288] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f2d90e06794c64b230249e14da48fd (127.9.142.189:35213), d5e00935e7b74f848b2eb20644a0798e (127.9.142.188:43753)
I20260811 07:19:14.526223 32556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fadd84384e3d4214b119032273806dce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5e00935e7b74f848b2eb20644a0798e" is_pre_election: true
I20260811 07:19:14.526217 32438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fadd84384e3d4214b119032273806dce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f2d90e06794c64b230249e14da48fd" is_pre_election: true
I20260811 07:19:14.526386 32438 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fadd84384e3d4214b119032273806dce in term 0.
I20260811 07:19:14.526388 32556 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fadd84384e3d4214b119032273806dce in term 0.
I20260811 07:19:14.526602 32284 leader_election.cc:302] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5e00935e7b74f848b2eb20644a0798e, fadd84384e3d4214b119032273806dce; no voters:
I20260811 07:19:14.526749 32635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:19:14.526819 32635 raft_consensus.cc:482] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:19:14.526847 32635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:14.527585 32635 raft_consensus.cc:504] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } }
I20260811 07:19:14.527758 32635 leader_election.cc:288] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [CANDIDATE]: Term 1 election: Requested vote from peers 18f2d90e06794c64b230249e14da48fd (127.9.142.189:35213), d5e00935e7b74f848b2eb20644a0798e (127.9.142.188:43753)
I20260811 07:19:14.528020 32556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fadd84384e3d4214b119032273806dce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5e00935e7b74f848b2eb20644a0798e"
I20260811 07:19:14.528102 32556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:14.528362 32438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fadd84384e3d4214b119032273806dce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f2d90e06794c64b230249e14da48fd"
I20260811 07:19:14.528452 32438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:14.528924 32556 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fadd84384e3d4214b119032273806dce in term 1.
I20260811 07:19:14.529110 32284 leader_election.cc:302] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5e00935e7b74f848b2eb20644a0798e, fadd84384e3d4214b119032273806dce; no voters:
I20260811 07:19:14.529196 32635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:14.529307 32635 raft_consensus.cc:686] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [term 1 LEADER]: Becoming Leader. State: Replica: fadd84384e3d4214b119032273806dce, State: Running, Role: LEADER
I20260811 07:19:14.529399 32438 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fadd84384e3d4214b119032273806dce in term 1.
I20260811 07:19:14.529402 32635 consensus_queue.cc:237] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } }
I20260811 07:19:14.529844 32685 sys_catalog.cc:455] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [sys.catalog]: SysCatalogTable state changed. Reason: New leader fadd84384e3d4214b119032273806dce. Latest consensus state: current_term: 1 leader_uuid: "fadd84384e3d4214b119032273806dce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.529955 32685 sys_catalog.cc:458] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:14.530179 32689 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:19:14.530360 32689 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:19:14.531713 32438 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [term 1 FOLLOWER]: Refusing update from remote peer fadd84384e3d4214b119032273806dce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:14.531718 32556 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [term 1 FOLLOWER]: Refusing update from remote peer fadd84384e3d4214b119032273806dce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:14.532061 32635 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:14.532176 32685 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:14.533411 32604 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fadd84384e3d4214b119032273806dce. Latest consensus state: current_term: 1 leader_uuid: "fadd84384e3d4214b119032273806dce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.533512 32604 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:19:14.533464 32661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader fadd84384e3d4214b119032273806dce. Latest consensus state: current_term: 1 leader_uuid: "fadd84384e3d4214b119032273806dce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.533546 32661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:19:14.534251 32635 sys_catalog.cc:455] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fadd84384e3d4214b119032273806dce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.534353 32635 sys_catalog.cc:458] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:14.534638 32689 catalog_manager.cc:1347] Generated new cluster ID: f043b6e874824cd089fc37ea06d2279f
I20260811 07:19:14.534693 32689 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:19:14.534797 32661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fadd84384e3d4214b119032273806dce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.534862 32661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:19:14.535176 32701 sys_catalog.cc:455] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fadd84384e3d4214b119032273806dce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.535260 32701 sys_catalog.cc:458] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:14.535470 32604 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fadd84384e3d4214b119032273806dce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fadd84384e3d4214b119032273806dce" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45451 } } peers { permanent_uuid: "18f2d90e06794c64b230249e14da48fd" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 35213 } } peers { permanent_uuid: "d5e00935e7b74f848b2eb20644a0798e" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43753 } } }
I20260811 07:19:14.535538 32604 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:19:14.535725 32690 mvcc.cc:205] Tried to move back new op lower bound from 7317228562559754240 to 7317228562552958976. Current Snapshot: MvccSnapshot[applied={T|T < 7317228562559754240 or (T in {7317228562559754240})}]
I20260811 07:19:14.535830 32691 mvcc.cc:205] Tried to move back new op lower bound from 7317228562559754240 to 7317228562552958976. Current Snapshot: MvccSnapshot[applied={T|T < 7317228562559754240 or (T in {7317228562559754240})}]
I20260811 07:19:14.535933 32693 mvcc.cc:205] Tried to move back new op lower bound from 7317228562559754240 to 7317228562552958976. Current Snapshot: MvccSnapshot[applied={T|T < 7317228562559754240 or (T in {7317228562559754240})}]
I20260811 07:19:14.548858 32689 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:19:14.549403 32689 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:19:14.554141 32689 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fadd84384e3d4214b119032273806dce: Generated new TSK 0
I20260811 07:19:14.554309 32689 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:19:15.340879 32629 catalog_manager.cc:1259] Loaded cluster ID: f043b6e874824cd089fc37ea06d2279f
I20260811 07:19:15.340955 32629 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e: loading cluster ID for follower catalog manager: success
I20260811 07:19:15.341719 32629 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e: acquiring CA information for follower catalog manager: success
I20260811 07:19:15.341969 32629 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d5e00935e7b74f848b2eb20644a0798e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:19:15.401073 32679 catalog_manager.cc:1259] Loaded cluster ID: f043b6e874824cd089fc37ea06d2279f
I20260811 07:19:15.401177 32679 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd: loading cluster ID for follower catalog manager: success
I20260811 07:19:15.401998 32679 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd: acquiring CA information for follower catalog manager: success
I20260811 07:19:15.402320 32679 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 18f2d90e06794c64b230249e14da48fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:19:15.611671 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 32260
I20260811 07:19:15.627022 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 32377
I20260811 07:19:15.636498 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 32490
2026-08-11T07:19:15Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3163 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:19:15 dist-test-slave-7f01 krb5kdc[32710](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:19:15 dist-test-slave-7f01 krb5kdc[32710](info): set up 2 sockets
Aug 11 07:19:15 dist-test-slave-7f01 krb5kdc[32710](info): commencing operation
krb5kdc: starting...
W20260811 07:19:16.917752 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:19:17 dist-test-slave-7f01 krb5kdc[32710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:19:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:19:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:19:17.038722 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33081
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:36943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:33081
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:17.123062 32731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:17.123296 32731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:17.123332 32731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:17.124483 32731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:17.124549 32731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:17.124574 32731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:17.124608 32731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:17.124635 32731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:17.126089 32731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:36943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:33081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:33081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:17.126360 32731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:17.126582 32731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:17.131544 32741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:17.131603 32742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:17.131804 32731 server_base.cc:1034] running on GCE node
W20260811 07:19:17.131548 32748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:17.132157 32731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:17.132475 32731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:17.133618 32731 hybrid_clock.cc:648] HybridClock initialized: now 1786432757133605 us; error 26 us; skew 500 ppm
Aug 11 07:19:17 dist-test-slave-7f01 krb5kdc[32710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432757, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:17.136865 32731 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:19:17.137331 32731 webserver.cc:460] Webserver started at http://127.9.142.190:44285/ using document root <none> and password file <none>
I20260811 07:19:17.137590 32731 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:17.137666 32731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:17.137833 32731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:17.138917 32731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "49398bb1cd0a4dee8d88b0c36bd98439"
format_stamp: "Formatted at 2026-08-11 07:19:17 on dist-test-slave-7f01"
server_key: "b7db5e72b8b5d959829719fa5481735e"
server_key_iv: "56287d239926ca7637b57638ece17e2b"
server_key_version: "encryptionkey@0"
I20260811 07:19:17.139335 32731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "49398bb1cd0a4dee8d88b0c36bd98439"
format_stamp: "Formatted at 2026-08-11 07:19:17 on dist-test-slave-7f01"
server_key: "b7db5e72b8b5d959829719fa5481735e"
server_key_iv: "56287d239926ca7637b57638ece17e2b"
server_key_version: "encryptionkey@0"
I20260811 07:19:17.140861 32731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:19:17.141633 32756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:17.141817 32731 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:19:17.141938 32731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "49398bb1cd0a4dee8d88b0c36bd98439"
format_stamp: "Formatted at 2026-08-11 07:19:17 on dist-test-slave-7f01"
server_key: "b7db5e72b8b5d959829719fa5481735e"
server_key_iv: "56287d239926ca7637b57638ece17e2b"
server_key_version: "encryptionkey@0"
I20260811 07:19:17.142020 32731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:17.165350 32731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:17.167941 32731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:17.168128 32731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:17.172614 32731 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:33081
I20260811 07:19:17.172663 367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:33081 every 8 connection(s)
I20260811 07:19:17.173062 32731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:19:17.173532 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 32731
I20260811 07:19:17.173662 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:19:17.173893 9786 external_mini_cluster.cc:1428] Setting key 9df17458929ff373a8bd33d07eab5974
I20260811 07:19:17.174369 369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:17.177618 369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439: Bootstrap starting.
I20260811 07:19:17.178328 369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:17.178645 369 log.cc:824] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:17.179479 369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439: No bootstrap required, opened a new log
Aug 11 07:19:17 dist-test-slave-7f01 krb5kdc[32710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:17.182286 369 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49398bb1cd0a4dee8d88b0c36bd98439" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33081 } }
I20260811 07:19:17.182502 369 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:17.182595 369 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49398bb1cd0a4dee8d88b0c36bd98439, State: Initialized, Role: FOLLOWER
I20260811 07:19:17.182773 369 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49398bb1cd0a4dee8d88b0c36bd98439" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33081 } }
I20260811 07:19:17.182868 369 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:19:17.182894 369 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:19:17.182969 369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:17.183604 369 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49398bb1cd0a4dee8d88b0c36bd98439" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33081 } }
I20260811 07:19:17.183754 369 leader_election.cc:302] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49398bb1cd0a4dee8d88b0c36bd98439; no voters:
I20260811 07:19:17.183952 369 leader_election.cc:288] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:19:17.184015 375 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:17.184213 375 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [term 1 LEADER]: Becoming Leader. State: Replica: 49398bb1cd0a4dee8d88b0c36bd98439, State: Running, Role: LEADER
I20260811 07:19:17.184242 369 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:19:17.184365 375 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49398bb1cd0a4dee8d88b0c36bd98439" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33081 } }
I20260811 07:19:17.184701 375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49398bb1cd0a4dee8d88b0c36bd98439. Latest consensus state: current_term: 1 leader_uuid: "49398bb1cd0a4dee8d88b0c36bd98439" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49398bb1cd0a4dee8d88b0c36bd98439" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33081 } } }
I20260811 07:19:17.184988 375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:17.184875 376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49398bb1cd0a4dee8d88b0c36bd98439" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49398bb1cd0a4dee8d88b0c36bd98439" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 33081 } } }
I20260811 07:19:17.185416 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:17.174443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45270 (local address 127.9.142.190:33081)
0811 07:19:17.174624 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:17.174641 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:17.174667 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:19:17.175111 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:17.175118 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:17.175163 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:17.175275 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:17.176102 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:17.177064 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:17.178138 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:17.178614 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:17.178700 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:17.181570 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:17.181574 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:17.181575 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:17.181585 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:17.183410 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:17.183891 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:17.183894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:17.183894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:17.184016 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:17.184295 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:17.184296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:17.184296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:17.184623 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:17.184753 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:17.185042 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 07:19:17.185196 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
I20260811 07:19:17.185424 376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:17.185580 390 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:19:17.186529 390 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:19:17.186889 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:19:17.188117 390 catalog_manager.cc:1347] Generated new cluster ID: c222f4232da64e31b9c7160a96682cd6
I20260811 07:19:17.188175 390 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:19:17.192956 390 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:19:17.193727 390 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:19:17.198995 390 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49398bb1cd0a4dee8d88b0c36bd98439: Generated new TSK 0
I20260811 07:19:17.199167 390 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:19:17.241220 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 32731
2026-08-11T07:19:17Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1603 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:19:17 dist-test-slave-7f01 krb5kdc[409](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:19:17 dist-test-slave-7f01 krb5kdc[409](info): set up 2 sockets
Aug 11 07:19:17 dist-test-slave-7f01 krb5kdc[409](info): commencing operation
krb5kdc: starting...
W20260811 07:19:18.505218 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:19:18 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:19:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:19:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:19:18.626835 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35847
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:35847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:18.710337 430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:18.710578 430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:18.710618 430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:18.712095 430 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:18.712183 430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:18.712222 430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:18.712255 430 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:18.712278 430 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:18.713819 430 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:35847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:18.714108 430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:18.714355 430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:18.719117 438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:18.719126 440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:18.719372 430 server_base.cc:1034] running on GCE node
W20260811 07:19:18.719126 436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:18.719682 430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:18.720059 430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:18.721251 430 hybrid_clock.cc:648] HybridClock initialized: now 1786432758721217 us; error 42 us; skew 500 ppm
Aug 11 07:19:18 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432758, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:18.723706 430 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:19:18.724236 430 webserver.cc:460] Webserver started at http://127.9.142.190:42367/ using document root <none> and password file <none>
I20260811 07:19:18.724474 430 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:18.724545 430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:18.724705 430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:18.725740 430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "ca86663743804545a6e7a5d6a5843e69"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "fafe5a560070f3837b0bad49b6039a92"
server_key_iv: "084fba0eeb24103f6ef8f16af2e9dd41"
server_key_version: "encryptionkey@0"
I20260811 07:19:18.726130 430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "ca86663743804545a6e7a5d6a5843e69"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "fafe5a560070f3837b0bad49b6039a92"
server_key_iv: "084fba0eeb24103f6ef8f16af2e9dd41"
server_key_version: "encryptionkey@0"
I20260811 07:19:18.727475 430 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:19:18.728271 452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:18.728456 430 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:18.728565 430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "ca86663743804545a6e7a5d6a5843e69"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "fafe5a560070f3837b0bad49b6039a92"
server_key_iv: "084fba0eeb24103f6ef8f16af2e9dd41"
server_key_version: "encryptionkey@0"
I20260811 07:19:18.728648 430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:18.743497 430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:18.745524 430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:18.745690 430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:18.749994 430 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:35847
I20260811 07:19:18.750028 537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:35847 every 8 connection(s)
I20260811 07:19:18.750424 430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:19:18.751457 538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:18.751533 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 430
I20260811 07:19:18.751638 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:19:18.751901 9786 external_mini_cluster.cc:1428] Setting key d0d4707c2a5ad9a9512187639c29b0b8
I20260811 07:19:18.754877 538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Bootstrap starting.
I20260811 07:19:18.755507 538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:18.755880 538 log.cc:824] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:18.756567 538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: No bootstrap required, opened a new log
Aug 11 07:19:18 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:18.758651 538 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:18.758847 538 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:18.758903 538 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86663743804545a6e7a5d6a5843e69, State: Initialized, Role: FOLLOWER
I20260811 07:19:18.759038 538 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:18.759135 538 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:19:18.759160 538 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:19:18.759236 538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:18.759994 538 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:18.760120 538 leader_election.cc:302] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca86663743804545a6e7a5d6a5843e69; no voters:
I20260811 07:19:18.760298 538 leader_election.cc:288] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:19:18.760354 546 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:18.760494 546 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 1 LEADER]: Becoming Leader. State: Replica: ca86663743804545a6e7a5d6a5843e69, State: Running, Role: LEADER
I20260811 07:19:18.760562 538 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:19:18.760643 546 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:18.761111 546 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca86663743804545a6e7a5d6a5843e69. Latest consensus state: current_term: 1 leader_uuid: "ca86663743804545a6e7a5d6a5843e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } } }
I20260811 07:19:18.761122 547 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca86663743804545a6e7a5d6a5843e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } } }
I20260811 07:19:18.761287 547 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:18.761273 546 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:18.761580 560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:19:18.762151 560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:19:18.763100 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:18.752459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45604 (local address 127.9.142.190:35847)
0811 07:19:18.752634 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:18.752642 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:18.752676 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:19:18.753102 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:18.753108 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:18.753151 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:18.753258 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:18.754055 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:18.754962 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:18.755839 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:18.756286 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:18.756412 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:18.759057 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:18.759061 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:18.759062 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:18.759073 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:18.761264 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:18.761701 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:18.761704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:18.761705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:18.761812 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:18.762043 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:18.762043 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:18.762044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:18.762355 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:18.762512 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:18.762768 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 07:19:18.762908 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260811 07:19:18.764112 560 catalog_manager.cc:1347] Generated new cluster ID: 097589adb3644df29e8b87e00b89e449
I20260811 07:19:18.764173 560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:19:18.771039 560 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:19:18.771536 560 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:19:18.779176 560 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Generated new TSK 0
I20260811 07:19:18.779348 560 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:19:18.814368 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:35847
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:18.900914 577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:18.901109 577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:18.901166 577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:18.902281 577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:18.902323 577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:18.902349 577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:19:18.903697 577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:35847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:18.903980 577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:18.904227 577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:18.909375 585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:18.909458 577 server_base.cc:1034] running on GCE node
W20260811 07:19:18.909577 587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:18.909379 591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:18.909873 577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:18.910089 577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:18.911262 577 hybrid_clock.cc:648] HybridClock initialized: now 1786432758911244 us; error 30 us; skew 500 ppm
Aug 11 07:19:18 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432758, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:18.913882 577 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:19:18.914265 577 webserver.cc:460] Webserver started at http://127.9.142.129:39425/ using document root <none> and password file <none>
I20260811 07:19:18.914443 577 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:18.914482 577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:18.914569 577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:18.915530 577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "3cc0bc5284c845a0ac273af2983dda85"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "71690c31754a9489fc0a74edbb73b8d5"
server_key_iv: "b692ab1048ee14170a22066af4c8182f"
server_key_version: "encryptionkey@0"
I20260811 07:19:18.915903 577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "3cc0bc5284c845a0ac273af2983dda85"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "71690c31754a9489fc0a74edbb73b8d5"
server_key_iv: "b692ab1048ee14170a22066af4c8182f"
server_key_version: "encryptionkey@0"
I20260811 07:19:18.917223 577 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:19:18.917897 599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:18.918084 577 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:19:18.918174 577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "3cc0bc5284c845a0ac273af2983dda85"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "71690c31754a9489fc0a74edbb73b8d5"
server_key_iv: "b692ab1048ee14170a22066af4c8182f"
server_key_version: "encryptionkey@0"
I20260811 07:19:18.918227 577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:18.940182 577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:18.941910 577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:18.942029 577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:18.942198 577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:18.942449 577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:18.942480 577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:18.942500 577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:18.942513 577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:18.948573 577 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:33353
I20260811 07:19:18.948649 772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:33353 every 8 connection(s)
I20260811 07:19:18.948964 577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:19:18.949891 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 577
I20260811 07:19:18.950034 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:19:18.950232 9786 external_mini_cluster.cc:1428] Setting key 5b43261b5f60bea3d6205ec7915992ff
Aug 11 07:19:18 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432758, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:18.958745 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:18.949691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:53767 (local address 127.9.142.190:35847)
0811 07:19:18.949736 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:18.949738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:18.949968 (+ 230us) server_negotiation.cc:407] Connection header received
0811 07:19:18.950582 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:18.950583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:18.950594 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:18.950664 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:18.951668 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:18.952446 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:18.953447 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:18.953676 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:18.953763 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:18.955861 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:18.955862 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:18.955863 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:18.955870 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:18.957284 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:18.957723 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:18.957725 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:18.957725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:18.957793 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:18.958087 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:18.958088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:18.958089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:18.958212 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:18.958287 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:18.958564 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 07:19:18.958653 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:19:18.958931 775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:18.949641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:53767)
0811 07:19:18.949844 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:18.949879 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:18.950470 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:18.950735 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:18.950738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:18.951383 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:18.951564 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:18.951568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:18.952554 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:18.952555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:18.953334 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:18.953336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:18.953776 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:18.953777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:18.953908 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:18.954368 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:18.954375 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:18.955717 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:18.957400 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:18.957408 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:18.957411 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:18.957639 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:18.957864 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:18.957864 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:18.957865 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:18.957998 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:18.958291 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:18.958299 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:18.958433 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 07:19:18.958541 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:19:18.958694 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":106,"threads_started":1}
I20260811 07:19:18.959491 773 heartbeater.cc:347] Connected to a master server at 127.9.142.190:35847
I20260811 07:19:18.959601 773 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:18.959824 773 heartbeater.cc:511] Master 127.9.142.190:35847 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
I20260811 07:19:18.960433 477 ts_manager.cc:194] Registered new tserver with Master: 3cc0bc5284c845a0ac273af2983dda85 (127.9.142.129:33353)
I20260811 07:19:18.961203 477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:53767
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:19:18.976464 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:35847
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:19.058842 779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:19.059022 779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:19.059044 779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:19.060236 779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:19.060276 779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:19.060302 779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:19:19.061942 779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:35847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:19.062119 779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:19.062283 779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:19.067098 791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:19.067109 788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:19.067132 789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:19.067272 779 server_base.cc:1034] running on GCE node
I20260811 07:19:19.067610 779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:19.067883 779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:19.069057 779 hybrid_clock.cc:648] HybridClock initialized: now 1786432759069051 us; error 35 us; skew 500 ppm
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:19.071587 779 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:19:19.072041 779 webserver.cc:460] Webserver started at http://127.9.142.130:44437/ using document root <none> and password file <none>
I20260811 07:19:19.072234 779 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:19.072273 779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:19.072360 779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:19.073274 779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "217ec754de3c4bdaa40ce3e0208459ac"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "498f5c9df50dbb24559a144c12a19607"
server_key_iv: "95c4a525d3824ba8671c83f9e37749ce"
server_key_version: "encryptionkey@0"
I20260811 07:19:19.073566 779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "217ec754de3c4bdaa40ce3e0208459ac"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "498f5c9df50dbb24559a144c12a19607"
server_key_iv: "95c4a525d3824ba8671c83f9e37749ce"
server_key_version: "encryptionkey@0"
I20260811 07:19:19.074787 779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:19:19.075502 801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.075690 779 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:19.075825 779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "217ec754de3c4bdaa40ce3e0208459ac"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "498f5c9df50dbb24559a144c12a19607"
server_key_iv: "95c4a525d3824ba8671c83f9e37749ce"
server_key_version: "encryptionkey@0"
I20260811 07:19:19.075883 779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:19.092216 779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:19.094432 779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:19.094537 779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:19.094700 779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:19.094944 779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:19.094974 779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.094995 779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:19.095007 779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.100677 779 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:38043
I20260811 07:19:19.100754 988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:38043 every 8 connection(s)
I20260811 07:19:19.101058 779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:19.109627 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.101826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:55915 (local address 127.9.142.190:35847)
0811 07:19:19.101891 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.101894 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.102115 (+ 221us) server_negotiation.cc:407] Connection header received
0811 07:19:19.102544 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.102546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.102555 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.102602 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:19.103458 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.103964 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.104889 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.105076 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.105126 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.107203 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:19.107205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:19.107205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:19.107212 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:19.108485 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.108839 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.108839 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.108840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.108890 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.109102 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.109102 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.109102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.109202 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:19.109253 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.109492 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.109561 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 07:19:19.109747 991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.101802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:55915)
0811 07:19:19.101994 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.102029 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.102466 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.102658 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.102661 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.103202 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:19.103381 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.103386 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.104043 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.104043 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.104816 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.104818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.105149 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.105150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.105255 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.105760 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:19.105768 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:19.107117 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:19.108557 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.108563 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.108565 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.108775 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.108950 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.108950 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.108951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.109048 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.109259 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:19.109264 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:19.109369 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.109454 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.109568 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":130,"threads_started":1}
I20260811 07:19:19.110244 989 heartbeater.cc:347] Connected to a master server at 127.9.142.190:35847
I20260811 07:19:19.110351 989 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:19.110534 989 heartbeater.cc:511] Master 127.9.142.190:35847 requested a full tablet report, sending...
I20260811 07:19:19.110955 477 ts_manager.cc:194] Registered new tserver with Master: 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043)
I20260811 07:19:19.111217 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 779
I20260811 07:19:19.111325 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:19:19.111390 477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:55915
I20260811 07:19:19.111554 9786 external_mini_cluster.cc:1428] Setting key 63a576b7df27910e7fb03e66388bbc2d
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:19:19.138651 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:35847
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:19.220322 998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:19.220554 998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:19.220592 998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:19.221792 998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:19.221860 998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:19.221904 998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:19:19.223383 998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:35847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:19.223646 998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:19.223963 998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:19.229072 1009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:19.229161 998 server_base.cc:1034] running on GCE node
W20260811 07:19:19.229087 1005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:19.229270 1006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:19.229492 998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:19.229729 998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:19.230890 998 hybrid_clock.cc:648] HybridClock initialized: now 1786432759230879 us; error 26 us; skew 500 ppm
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:19.233479 998 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:19:19.233944 998 webserver.cc:460] Webserver started at http://127.9.142.131:41543/ using document root <none> and password file <none>
I20260811 07:19:19.234177 998 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:19.234246 998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:19.234398 998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:19.235410 998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "4260f9d05e0849a79e330f4cf7b06519"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "59c2de62179fe66ebcb5a2215e4e8176"
server_key_iv: "62fbd13eed7379db52f70c5b00643bcf"
server_key_version: "encryptionkey@0"
I20260811 07:19:19.235832 998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "4260f9d05e0849a79e330f4cf7b06519"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "59c2de62179fe66ebcb5a2215e4e8176"
server_key_iv: "62fbd13eed7379db52f70c5b00643bcf"
server_key_version: "encryptionkey@0"
I20260811 07:19:19.237144 998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:19.237854 1025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.238147 998 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:19.238258 998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "4260f9d05e0849a79e330f4cf7b06519"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "59c2de62179fe66ebcb5a2215e4e8176"
server_key_iv: "62fbd13eed7379db52f70c5b00643bcf"
server_key_version: "encryptionkey@0"
I20260811 07:19:19.238332 998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:19.249855 998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:19.252110 998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:19.252265 998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:19.252478 998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:19.252812 998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:19.252867 998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.252907 998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:19.252941 998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.258957 998 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:41317
I20260811 07:19:19.258999 1207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:41317 every 8 connection(s)
I20260811 07:19:19.259322 998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:19:19.263150 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 998
I20260811 07:19:19.263244 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:19:19.263406 9786 external_mini_cluster.cc:1428] Setting key 73e8f4483db5cc44969f880b7464ab5c
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:19.268628 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.260016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:36029 (local address 127.9.142.190:35847)
0811 07:19:19.260062 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.260065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.260302 (+ 237us) server_negotiation.cc:407] Connection header received
0811 07:19:19.260819 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.260821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.260831 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.260882 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:19.261871 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.262367 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.263648 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.263928 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.264014 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.266069 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:19.266070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:19.266070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:19.266077 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:19.267493 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.267899 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.267900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.267901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.267954 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.268157 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.268157 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.268157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.268249 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:19.268294 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.268508 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.268566 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:19:19.268841 1211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.260006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:36029)
0811 07:19:19.260190 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.260224 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.260735 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.260934 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.260937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.261565 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:19.261785 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.261792 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.262480 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.262482 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.263531 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.263534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.264027 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.264028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.264192 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.264571 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:19.264580 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:19.265985 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:19.267567 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.267574 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.267576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.267845 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.268013 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.268014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.268014 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.268115 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.268299 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:19.268304 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:19.268408 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.268490 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.268603 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260811 07:19:19.269312 1208 heartbeater.cc:347] Connected to a master server at 127.9.142.190:35847
I20260811 07:19:19.269390 1208 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:19.269572 1208 heartbeater.cc:511] Master 127.9.142.190:35847 requested a full tablet report, sending...
I20260811 07:19:19.269938 477 ts_manager.cc:194] Registered new tserver with Master: 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317)
I20260811 07:19:19.270309 477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:36029
I20260811 07:19:19.274941 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:19:19.282553 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.276311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45614 (local address 127.9.142.190:35847)
0811 07:19:19.276390 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.276392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.276486 (+ 94us) server_negotiation.cc:407] Connection header received
0811 07:19:19.276560 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.276561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.276571 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.276619 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:19.277166 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.277626 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.278426 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.278625 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.278697 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.279984 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:19.279985 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:19.279985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:19.279992 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:19.281358 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.281721 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.281722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.281723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.281788 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.282019 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.282020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.282020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.282160 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:19.282271 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.282380 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.282461 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:19:19.284025 477 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:19:19.285571 477 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:19:19.292372 1230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.288320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:38043 (local address 127.0.0.1:45172)
0811 07:19:19.288552 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.288562 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.288657 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.288912 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.288913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.288914 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:19.288980 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.288981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.289843 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.289844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.291177 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.291180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.291879 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.291880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.292120 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.292142 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.292242 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.292300 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":42,"thread_start_us":91,"threads_started":1}
I20260811 07:19:19.292397 1226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.287917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45172 (local address 127.9.142.130:38043)
0811 07:19:19.288109 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.288113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.288629 (+ 516us) server_negotiation.cc:407] Connection header received
0811 07:19:19.288754 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.288757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.288775 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.288834 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:19.289052 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.289733 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.291262 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.291795 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.291868 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.291933 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.292272 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.292320 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":111,"threads_started":1}
I20260811 07:19:19.292883 1221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.287778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33353 (local address 127.0.0.1:58774)
0811 07:19:19.287929 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.287966 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.288034 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.288684 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.288685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.288687 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:19.288732 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.288733 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.290019 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.290020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.291177 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.291180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.292650 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.292651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.292720 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.292724 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.292781 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.292819 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":9,"thread_start_us":51,"threads_started":1}
I20260811 07:19:19.293133 1228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.287980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58774 (local address 127.9.142.129:33353)
0811 07:19:19.288533 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.288537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.288547 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:19:19.288589 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.288591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.288608 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.288689 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:19.288781 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.289912 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.291816 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.292558 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.292634 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.292682 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.292819 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.292866 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":94,"threads_started":1}
I20260811 07:19:19.293329 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.287778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:41317 (local address 127.0.0.1:50836)
0811 07:19:19.288179 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.288188 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.288226 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.288516 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.288520 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.288522 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:19.288590 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.288592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.291284 (+ 2692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.291285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.292132 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.292135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.293102 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.293103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.293166 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.293169 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.293217 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.293255 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":3,"thread_start_us":71,"threads_started":1}
I20260811 07:19:19.293561 1229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.288149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50836 (local address 127.9.142.131:41317)
0811 07:19:19.288325 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.288329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.288339 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:19:19.288377 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.288380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.288397 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.288492 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:19.288840 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.289912 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.292220 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.292946 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.293012 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.293067 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.293450 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.293491 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":110,"threads_started":1}
I20260811 07:19:19.293442 876 tablet_service.cc:1467] Processing CreateTablet for tablet 757f197b296b42debf0ec4fd75eb3c97 (DEFAULT_TABLE table=test-table [id=b4b106f952fe489c978c83d41f6206b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:19.293833 876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 757f197b296b42debf0ec4fd75eb3c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:19.293774 671 tablet_service.cc:1467] Processing CreateTablet for tablet 757f197b296b42debf0ec4fd75eb3c97 (DEFAULT_TABLE table=test-table [id=b4b106f952fe489c978c83d41f6206b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:19.294142 671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 757f197b296b42debf0ec4fd75eb3c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:19.294152 1103 tablet_service.cc:1467] Processing CreateTablet for tablet 757f197b296b42debf0ec4fd75eb3c97 (DEFAULT_TABLE table=test-table [id=b4b106f952fe489c978c83d41f6206b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:19.294461 1103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 757f197b296b42debf0ec4fd75eb3c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:19.296536 1231 tablet_bootstrap.cc:492] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Bootstrap starting.
I20260811 07:19:19.297135 1231 tablet_bootstrap.cc:654] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:19.297588 1234 tablet_bootstrap.cc:492] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Bootstrap starting.
I20260811 07:19:19.297708 1231 log.cc:824] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:19.297973 1235 tablet_bootstrap.cc:492] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: Bootstrap starting.
I20260811 07:19:19.298292 1234 tablet_bootstrap.cc:654] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:19.298627 1235 tablet_bootstrap.cc:654] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:19.298640 1231 tablet_bootstrap.cc:492] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: No bootstrap required, opened a new log
I20260811 07:19:19.298795 1231 ts_tablet_manager.cc:1397] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:19.298898 1234 log.cc:824] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:19.299283 1235 log.cc:824] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:19.299765 1234 tablet_bootstrap.cc:492] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: No bootstrap required, opened a new log
I20260811 07:19:19.299837 1234 ts_tablet_manager.cc:1397] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:19.300102 1235 tablet_bootstrap.cc:492] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: No bootstrap required, opened a new log
I20260811 07:19:19.300180 1235 ts_tablet_manager.cc:1397] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:19.300952 1231 raft_consensus.cc:348] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.301142 1231 raft_consensus.cc:374] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:19.301182 1231 raft_consensus.cc:729] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 217ec754de3c4bdaa40ce3e0208459ac, State: Initialized, Role: FOLLOWER
I20260811 07:19:19.301317 1231 consensus_queue.cc:260] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.301337 1234 raft_consensus.cc:348] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.301517 1234 raft_consensus.cc:374] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:19.301565 1234 raft_consensus.cc:729] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cc0bc5284c845a0ac273af2983dda85, State: Initialized, Role: FOLLOWER
I20260811 07:19:19.301626 1231 ts_tablet_manager.cc:1428] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:19:19.301692 1234 consensus_queue.cc:260] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.301764 989 heartbeater.cc:503] Master 127.9.142.190:35847 was elected leader, sending a full tablet report...
I20260811 07:19:19.301999 1234 ts_tablet_manager.cc:1428] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:19.302014 773 heartbeater.cc:503] Master 127.9.142.190:35847 was elected leader, sending a full tablet report...
I20260811 07:19:19.302227 1235 raft_consensus.cc:348] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.302399 1235 raft_consensus.cc:374] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:19.302448 1235 raft_consensus.cc:729] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4260f9d05e0849a79e330f4cf7b06519, State: Initialized, Role: FOLLOWER
I20260811 07:19:19.302556 1235 consensus_queue.cc:260] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.302865 1235 ts_tablet_manager.cc:1428] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:19:19.303136 1208 heartbeater.cc:503] Master 127.9.142.190:35847 was elected leader, sending a full tablet report...
W20260811 07:19:19.351749 990 tablet.cc:2369] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:19:19.449767 774 tablet.cc:2369] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:19:19.463021 1242 raft_consensus.cc:482] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:19.463156 1242 raft_consensus.cc:504] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.463560 1242 leader_election.cc:288] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cc0bc5284c845a0ac273af2983dda85 (127.9.142.129:33353), 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317)
I20260811 07:19:19.466635 1228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.463905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:33809 (local address 127.9.142.129:33353)
0811 07:19:19.463964 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.463967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.464130 (+ 163us) server_negotiation.cc:407] Connection header received
0811 07:19:19.464193 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.464194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.464213 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.464280 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:19.464452 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.464931 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.465927 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.466284 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.466365 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.466383 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.466528 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.466564 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 07:19:19.466647 1246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.463830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33353 (local address 127.9.142.130:33809)
0811 07:19:19.464055 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.464064 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.464136 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.464283 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.464284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.464285 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:19.464369 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.464371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.465022 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.465023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.465817 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.465819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.466376 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.466377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.466453 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.466458 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.466522 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.466562 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":139,"threads_started":1}
I20260811 07:19:19.466854 991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.463802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:41317 (local address 127.9.142.130:39021)
0811 07:19:19.463864 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.463894 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.463946 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.464232 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.464233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.464235 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:19.464338 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.464340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.465105 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.465106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.465935 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.465938 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.466531 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.466533 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.466621 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.466624 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.466706 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.466755 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 07:19:19.466886 1229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.464014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:39021 (local address 127.9.142.131:41317)
0811 07:19:19.464086 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.464088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.464097 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:19:19.464126 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.464127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.464137 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.464226 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:19.464535 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.465011 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.466030 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.466449 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.466535 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.466544 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.466748 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.466817 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 07:19:19.467223 697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "757f197b296b42debf0ec4fd75eb3c97" candidate_uuid: "217ec754de3c4bdaa40ce3e0208459ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cc0bc5284c845a0ac273af2983dda85" is_pre_election: true
I20260811 07:19:19.467221 1135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "757f197b296b42debf0ec4fd75eb3c97" candidate_uuid: "217ec754de3c4bdaa40ce3e0208459ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4260f9d05e0849a79e330f4cf7b06519" is_pre_election: true
I20260811 07:19:19.467398 697 raft_consensus.cc:2454] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 217ec754de3c4bdaa40ce3e0208459ac in term 0.
I20260811 07:19:19.467417 1135 raft_consensus.cc:2454] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 217ec754de3c4bdaa40ce3e0208459ac in term 0.
I20260811 07:19:19.467648 802 leader_election.cc:302] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 217ec754de3c4bdaa40ce3e0208459ac, 4260f9d05e0849a79e330f4cf7b06519; no voters:
I20260811 07:19:19.467820 1242 raft_consensus.cc:2781] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:19:19.467890 1242 raft_consensus.cc:482] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:19:19.467908 1242 raft_consensus.cc:3037] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:19.468703 1242 raft_consensus.cc:504] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.468856 1242 leader_election.cc:288] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [CANDIDATE]: Term 1 election: Requested vote from peers 3cc0bc5284c845a0ac273af2983dda85 (127.9.142.129:33353), 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317)
I20260811 07:19:19.469043 697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "757f197b296b42debf0ec4fd75eb3c97" candidate_uuid: "217ec754de3c4bdaa40ce3e0208459ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cc0bc5284c845a0ac273af2983dda85"
I20260811 07:19:19.469110 697 raft_consensus.cc:3037] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:19.469125 1135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "757f197b296b42debf0ec4fd75eb3c97" candidate_uuid: "217ec754de3c4bdaa40ce3e0208459ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4260f9d05e0849a79e330f4cf7b06519"
I20260811 07:19:19.469225 1135 raft_consensus.cc:3037] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:19.469883 697 raft_consensus.cc:2454] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 217ec754de3c4bdaa40ce3e0208459ac in term 1.
I20260811 07:19:19.470074 806 leader_election.cc:302] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 217ec754de3c4bdaa40ce3e0208459ac, 3cc0bc5284c845a0ac273af2983dda85; no voters:
I20260811 07:19:19.470090 1135 raft_consensus.cc:2454] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 217ec754de3c4bdaa40ce3e0208459ac in term 1.
I20260811 07:19:19.470177 1242 raft_consensus.cc:2781] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:19.470361 1242 raft_consensus.cc:686] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 1 LEADER]: Becoming Leader. State: Replica: 217ec754de3c4bdaa40ce3e0208459ac, State: Running, Role: LEADER
I20260811 07:19:19.470479 1242 consensus_queue.cc:237] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.471426 474 catalog_manager.cc:5495] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130). New cstate: current_term: 1 leader_uuid: "217ec754de3c4bdaa40ce3e0208459ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260811 07:19:19.476432 1226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.474156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45182 (local address 127.9.142.130:38043)
0811 07:19:19.474198 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.474200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.474209 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:19:19.474277 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.474278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.474294 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.474345 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:19:19.474462 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.474887 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.475645 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.475889 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.475943 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.476101 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:19:19.476203 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:19:19.476299 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.476318 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.476339 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:19:19.478160 1135 raft_consensus.cc:1261] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [term 1 FOLLOWER]: Refusing update from remote peer 217ec754de3c4bdaa40ce3e0208459ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:19.478160 697 raft_consensus.cc:1261] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Refusing update from remote peer 217ec754de3c4bdaa40ce3e0208459ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:19.478497 1242 consensus_queue.cc:1035] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:19.478667 1248 consensus_queue.cc:1035] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:19.481091 1252 mvcc.cc:205] Tried to move back new op lower bound from 7317228582819717120 to 7317228582791655424. Current Snapshot: MvccSnapshot[applied={T|T < 7317228582819717120}]
I20260811 07:19:19.482388 1253 mvcc.cc:205] Tried to move back new op lower bound from 7317228582819717120 to 7317228582791655424. Current Snapshot: MvccSnapshot[applied={T|T < 7317228582819717120 or (T in {7317228582819717120})}]
I20260811 07:19:19.483541 477 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:19.483632 477 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:19.484383 477 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Sending DeleteTablet for 3 replicas of tablet 757f197b296b42debf0ec4fd75eb3c97
I20260811 07:19:19.484716 1103 tablet_service.cc:1514] Processing DeleteTablet for tablet 757f197b296b42debf0ec4fd75eb3c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:19 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:50836
I20260811 07:19:19.484727 671 tablet_service.cc:1514] Processing DeleteTablet for tablet 757f197b296b42debf0ec4fd75eb3c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:19 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:58774
I20260811 07:19:19.484818 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 577
I20260811 07:19:19.484946 876 tablet_service.cc:1514] Processing DeleteTablet for tablet 757f197b296b42debf0ec4fd75eb3c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:19 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:45172
I20260811 07:19:19.485387 1270 tablet_replica.cc:330] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: stopping tablet replica
I20260811 07:19:19.485514 1270 raft_consensus.cc:2229] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:19.485639 1270 raft_consensus.cc:2258] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:19.488037 1270 ts_tablet_manager.cc:1905] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:19.490343 1270 ts_tablet_manager.cc:1918] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:19.490446 1270 log.cc:1196] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/757f197b296b42debf0ec4fd75eb3c97
I20260811 07:19:19.490800 1270 ts_tablet_manager.cc:1939] T 757f197b296b42debf0ec4fd75eb3c97 P 4260f9d05e0849a79e330f4cf7b06519: Deleting consensus metadata
I20260811 07:19:19.491349 453 catalog_manager.cc:4841] TS 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317): tablet 757f197b296b42debf0ec4fd75eb3c97 (table test-table [id=b4b106f952fe489c978c83d41f6206b6]) successfully deleted
I20260811 07:19:19.503878 1273 tablet_replica.cc:330] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: stopping tablet replica
I20260811 07:19:19.504032 1273 raft_consensus.cc:2229] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:19:19.504151 1273 raft_consensus.cc:2258] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:19.504580 1273 ts_tablet_manager.cc:1905] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:19:19.505618 455 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:33353 (error 108)
I20260811 07:19:19.506129 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.506006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33353 (local address 127.0.0.1:58788)
0811 07:19:19.506053 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.506092 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 07:19:19.506258 455 catalog_manager.cc:4584] TS 3cc0bc5284c845a0ac273af2983dda85 (127.9.142.129:33353): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 757f197b296b42debf0ec4fd75eb3c97: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33353: connect: Connection refused (error 111)
I20260811 07:19:19.506271 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 779
I20260811 07:19:19.523984 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.523836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:38043 (local address 127.0.0.1:45192)
0811 07:19:19.523903 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.523945 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.130:38043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 07:19:19.523994 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 998
I20260811 07:19:19.533033 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 430
I20260811 07:19:19.547464 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35847
--webserver_interface=127.9.142.190
--webserver_port=42367
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:35847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:19.631070 1276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:19.631296 1276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:19.631335 1276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:19.632475 1276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:19.632540 1276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:19.632565 1276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:19.632598 1276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:19.632625 1276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:19.634054 1276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:35847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=42367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:19.634322 1276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:19.634546 1276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:19.644069 1289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:19.644034 1292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:19.644237 1276 server_base.cc:1034] running on GCE node
W20260811 07:19:19.644034 1295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:19.644543 1276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:19.644848 1276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:19.645992 1276 hybrid_clock.cc:648] HybridClock initialized: now 1786432759645984 us; error 34 us; skew 500 ppm
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:19.648662 1276 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:19:19.649118 1276 webserver.cc:460] Webserver started at http://127.9.142.190:42367/ using document root <none> and password file <none>
I20260811 07:19:19.649314 1276 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:19.649366 1276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:19.650655 1276 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:19.651299 1306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.651492 1276 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:19:19.651607 1276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "ca86663743804545a6e7a5d6a5843e69"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "fafe5a560070f3837b0bad49b6039a92"
server_key_iv: "084fba0eeb24103f6ef8f16af2e9dd41"
server_key_version: "encryptionkey@0"
I20260811 07:19:19.652064 1276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:19.662142 1276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:19.664465 1276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:19.664626 1276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:19.668741 1276 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:35847
I20260811 07:19:19.668778 1395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:35847 every 8 connection(s)
I20260811 07:19:19.669189 1276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:19:19.670878 1396 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:19:19.671563 1396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Bootstrap starting.
I20260811 07:19:19.673223 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 1276
I20260811 07:19:19.673501 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:33353
--local_ip_for_outbound_sockets=127.9.142.129
--tserver_master_addrs=127.9.142.190:35847
--webserver_port=39425
--webserver_interface=127.9.142.129
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:19:19.681694 1396 log.cc:824] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:19.683797 1396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:19:19.684144 1396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Bootstrap complete.
I20260811 07:19:19.686586 1396 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:19.686836 1396 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86663743804545a6e7a5d6a5843e69, State: Initialized, Role: FOLLOWER
I20260811 07:19:19.687029 1396 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:19.687093 1396 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:19:19.687150 1396 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:19:19.687222 1396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:19:19.688452 1396 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:19.688577 1396 leader_election.cc:302] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca86663743804545a6e7a5d6a5843e69; no voters:
I20260811 07:19:19.688802 1396 leader_election.cc:288] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:19:19.688838 1401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:19:19.689018 1401 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 2 LEADER]: Becoming Leader. State: Replica: ca86663743804545a6e7a5d6a5843e69, State: Running, Role: LEADER
I20260811 07:19:19.689105 1396 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:19:19.689188 1401 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:19.689491 1401 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca86663743804545a6e7a5d6a5843e69. Latest consensus state: current_term: 2 leader_uuid: "ca86663743804545a6e7a5d6a5843e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } } }
I20260811 07:19:19.689579 1401 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:19.689495 1403 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ca86663743804545a6e7a5d6a5843e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } } }
I20260811 07:19:19.689779 1403 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:19.691138 1436 catalog_manager.cc:1259] Loaded cluster ID: 097589adb3644df29e8b87e00b89e449
I20260811 07:19:19.691192 1436 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: loading cluster ID for follower catalog manager: success
W20260811 07:19:19.691399 1436 catalog_manager.cc:1576] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260811 07:19:19.691454 1436 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260811 07:19:19.691496 1416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:19:19.691907 1416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:19:19.692008 1416 catalog_manager.cc:1259] Loaded cluster ID: 097589adb3644df29e8b87e00b89e449
I20260811 07:19:19.692040 1416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:19:19.692196 1416 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 07:19:19.694909 1416 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 07:19:19.697220 1416 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:19:19.697417 1416 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Loaded TSK: 0
I20260811 07:19:19.697642 1416 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:19:19.761348 1399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:19.761581 1399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:19.761619 1399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:19.762737 1399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:19.762807 1399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:19.762852 1399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:19:19.764411 1399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:33353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=39425
--tserver_master_addrs=127.9.142.190:35847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:19.764668 1399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:19.764916 1399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:19.770023 1454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:19.770068 1447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:19.770272 1448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:19.770368 1399 server_base.cc:1034] running on GCE node
I20260811 07:19:19.770558 1399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:19.770798 1399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:19.771966 1399 hybrid_clock.cc:648] HybridClock initialized: now 1786432759771953 us; error 31 us; skew 500 ppm
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:19.774459 1399 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:19:19.774989 1399 webserver.cc:460] Webserver started at http://127.9.142.129:39425/ using document root <none> and password file <none>
I20260811 07:19:19.775238 1399 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:19.775293 1399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:19.776815 1399 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:19.777576 1469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.777781 1399 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:19.777896 1399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "3cc0bc5284c845a0ac273af2983dda85"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "71690c31754a9489fc0a74edbb73b8d5"
server_key_iv: "b692ab1048ee14170a22066af4c8182f"
server_key_version: "encryptionkey@0"
I20260811 07:19:19.778321 1399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:19.804404 1399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:19.806871 1399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:19.807049 1399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:19.807317 1399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:19.807881 1481 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:19:19.809896 1399 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:19:19.809979 1399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 07:19:19.810027 1399 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:19:19.810699 1399 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:19:19.810757 1399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:19.810827 1481 tablet_bootstrap.cc:492] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Bootstrap starting.
I20260811 07:19:19.818430 1399 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:33353
I20260811 07:19:19.818815 1399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:19:19.820142 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 1399
I20260811 07:19:19.820447 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:38043
--local_ip_for_outbound_sockets=127.9.142.130
--tserver_master_addrs=127.9.142.190:35847
--webserver_port=44437
--webserver_interface=127.9.142.130
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:19:19.822818 1481 log.cc:824] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:19.823169 1657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:33353 every 8 connection(s)
I20260811 07:19:19.825678 1481 tablet_bootstrap.cc:492] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:19:19.826059 1481 tablet_bootstrap.cc:492] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Bootstrap complete.
I20260811 07:19:19.827543 1481 ts_tablet_manager.cc:1397] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.009s
I20260811 07:19:19.829582 1481 raft_consensus.cc:348] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.830013 1481 raft_consensus.cc:729] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cc0bc5284c845a0ac273af2983dda85, State: Initialized, Role: FOLLOWER
I20260811 07:19:19.830165 1481 consensus_queue.cc:260] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } } peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } }
I20260811 07:19:19.830459 1481 ts_tablet_manager.cc:1428] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:19.835692 1663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.819654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:49175)
0811 07:19:19.823424 (+ 3770us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.823472 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.824157 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.824769 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.824774 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.825167 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:19.825445 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.825452 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.827172 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.827174 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.828473 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.828476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.829368 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.829369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.829501 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.830663 (+ 1162us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:19.830671 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:19.832114 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:19.834051 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.834059 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.834061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.834292 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.834575 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.834576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.834577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.834691 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.835063 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:19.835071 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:19.835210 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.835310 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.835485 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3725,"thread_start_us":123,"threads_started":1}
I20260811 07:19:19.835692 1664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.819761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:49175 (local address 127.9.142.190:35847)
0811 07:19:19.823562 (+ 3801us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.823572 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.823624 (+ 52us) server_negotiation.cc:407] Connection header received
0811 07:19:19.824410 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.824418 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.824476 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.824618 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:19.825587 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.827060 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.828573 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.829167 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.829270 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.832228 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:19.832232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:19.832233 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:19.832252 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:19.833943 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.834401 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.834404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.834404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.834493 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.834766 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.834766 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.834767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.834987 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:19.835086 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.835393 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.835522 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3741,"thread_start_us":83,"threads_started":1}
I20260811 07:19:19.836848 1659 heartbeater.cc:347] Connected to a master server at 127.9.142.190:35847
I20260811 07:19:19.836977 1659 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:19.837170 1659 heartbeater.cc:511] Master 127.9.142.190:35847 requested a full tablet report, sending...
I20260811 07:19:19.837913 1338 ts_manager.cc:194] Registered new tserver with Master: 3cc0bc5284c845a0ac273af2983dda85 (127.9.142.129:33353)
I20260811 07:19:19.839025 1338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:49175
I20260811 07:19:19.840049 1659 heartbeater.cc:503] Master 127.9.142.190:35847 was elected leader, sending a full tablet report...
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:19:19.848111 1668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.838503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33353 (local address 127.0.0.1:58802)
0811 07:19:19.839265 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.839303 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.839373 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.839666 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.839673 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.840020 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:19.840078 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.840080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.841558 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.841559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.842163 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.842165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.842804 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.842805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.842891 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.843459 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:19.843464 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:19.845100 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:19.847039 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.847046 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.847048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.847237 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.847467 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.847468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.847468 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.847525 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.847833 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:19.847840 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:19.847883 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.847948 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.848041 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":87,"threads_started":1}
I20260811 07:19:19.848181 1672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.838739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58802 (local address 127.9.142.129:33353)
0811 07:19:19.839499 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.839515 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.839524 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:19:19.839559 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.839561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.839575 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.839641 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:19.840164 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.841451 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.842254 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.842710 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.842782 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.845189 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:19.845198 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:19.845198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:19.845205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:19.846950 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.847322 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.847325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.847325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.847394 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.847587 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.847588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.847588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.847767 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:19.847845 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.848004 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.848091 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":64,"threads_started":1}
I20260811 07:19:19.848762 1553 tablet_service.cc:1514] Processing DeleteTablet for tablet 757f197b296b42debf0ec4fd75eb3c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:19 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:58802
I20260811 07:19:19.849292 1673 tablet_replica.cc:330] stopping tablet replica
I20260811 07:19:19.849427 1673 raft_consensus.cc:2229] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:19.849504 1673 raft_consensus.cc:2258] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:19.849944 1673 ts_tablet_manager.cc:1905] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:19.852222 1673 ts_tablet_manager.cc:1918] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:19.852319 1673 log.cc:1196] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/757f197b296b42debf0ec4fd75eb3c97
I20260811 07:19:19.852548 1673 ts_tablet_manager.cc:1939] T 757f197b296b42debf0ec4fd75eb3c97 P 3cc0bc5284c845a0ac273af2983dda85: Deleting consensus metadata
I20260811 07:19:19.853070 1310 catalog_manager.cc:4841] TS 3cc0bc5284c845a0ac273af2983dda85 (127.9.142.129:33353): tablet 757f197b296b42debf0ec4fd75eb3c97 (table test-table [id=b4b106f952fe489c978c83d41f6206b6]) successfully deleted
W20260811 07:19:19.927546 1665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:19.927851 1665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:19.927906 1665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:19.929144 1665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:19.929189 1665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:19.929216 1665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:19:19.930670 1665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:38043
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=44437
--tserver_master_addrs=127.9.142.190:35847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:19.930919 1665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:19.931157 1665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:19.936245 1679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:19.936272 1682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:19.936324 1665 server_base.cc:1034] running on GCE node
W20260811 07:19:19.936278 1680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:19.936656 1665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:19.936914 1665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:19.938086 1665 hybrid_clock.cc:648] HybridClock initialized: now 1786432759938085 us; error 38 us; skew 500 ppm
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:19.944204 1665 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:19:19.944730 1665 webserver.cc:460] Webserver started at http://127.9.142.130:44437/ using document root <none> and password file <none>
I20260811 07:19:19.944977 1665 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:19.945071 1665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:19.946470 1665 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:19.947228 1692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.947424 1665 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:19.947538 1665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "217ec754de3c4bdaa40ce3e0208459ac"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "498f5c9df50dbb24559a144c12a19607"
server_key_iv: "95c4a525d3824ba8671c83f9e37749ce"
server_key_version: "encryptionkey@0"
I20260811 07:19:19.947971 1665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:19.967893 1665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:19.970546 1665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:19.970752 1665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:19.971030 1665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:19.971560 1703 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260811 07:19:19.973084 1703 ts_tablet_manager.cc:1852] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260811 07:19:19.973362 1703 ts_tablet_manager.cc:1905] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:19.975646 1703 ts_tablet_manager.cc:1918] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:19.975787 1703 log.cc:1196] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/757f197b296b42debf0ec4fd75eb3c97
I20260811 07:19:19.976140 1703 ts_tablet_manager.cc:1939] T 757f197b296b42debf0ec4fd75eb3c97 P 217ec754de3c4bdaa40ce3e0208459ac: Deleting consensus metadata
I20260811 07:19:19.976402 1665 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260811 07:19:19.976495 1665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260811 07:19:19.976553 1665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:19.976584 1665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:19.984880 1665 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:38043
I20260811 07:19:19.984953 1880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:38043 every 8 connection(s)
I20260811 07:19:19.985280 1665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:19:19.989539 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 1665
I20260811 07:19:19.989858 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:41317
--local_ip_for_outbound_sockets=127.9.142.131
--tserver_master_addrs=127.9.142.190:35847
--webserver_port=41543
--webserver_interface=127.9.142.131
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:19:19 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432759, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:19.996709 1664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.986195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:60113 (local address 127.9.142.190:35847)
0811 07:19:19.986258 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:19.986260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:19.986485 (+ 225us) server_negotiation.cc:407] Connection header received
0811 07:19:19.987044 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:19.987045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:19.987060 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:19.987126 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:19.988021 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.988542 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.989950 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.990178 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.990304 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.993326 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:19.993328 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:19.993328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:19.993342 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:19.994871 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.995470 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.995471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.995471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.995527 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:19.995954 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:19.995954 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:19.995955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:19.996075 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:19.996130 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:19.996545 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 07:19:19.996640 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 07:19:19.996992 1883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:19.986155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:60113)
0811 07:19:19.986335 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:19.986383 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:19.986933 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:19.987199 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:19.987202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:19.987593 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:19.987916 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.987923 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.988687 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.988688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.989839 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:19.989842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:19.990321 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:19.990323 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:19.990487 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:19.991183 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:19.991195 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:19.993208 (+ 2013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:19.994965 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.994974 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.994976 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.995333 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.995604 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:19.995605 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:19.995606 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:19.995796 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:19.996149 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:19.996157 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:19.996343 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 07:19:19.996471 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 07:19:19.996676 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260811 07:19:19.997617 1881 heartbeater.cc:347] Connected to a master server at 127.9.142.190:35847
I20260811 07:19:19.997716 1881 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:19.997925 1881 heartbeater.cc:511] Master 127.9.142.190:35847 requested a full tablet report, sending...
I20260811 07:19:19.998381 1338 ts_manager.cc:194] Registered new tserver with Master: 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043)
I20260811 07:19:19.998768 1338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:60113
W20260811 07:19:20.078960 1884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:20.079229 1884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:20.079268 1884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:20.080499 1884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:20.080574 1884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:20.080621 1884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:19:20.082160 1884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:41317
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=41543
--tserver_master_addrs=127.9.142.190:35847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:20.082472 1884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:20.082733 1884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:20.087994 1892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:20.088004 1891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:20.088006 1897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:20.088203 1884 server_base.cc:1034] running on GCE node
I20260811 07:19:20.088460 1884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:20.088712 1884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:20.089895 1884 hybrid_clock.cc:648] HybridClock initialized: now 1786432760089879 us; error 27 us; skew 500 ppm
Aug 11 07:19:20 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432760, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:20.092764 1884 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:19:20.093233 1884 webserver.cc:460] Webserver started at http://127.9.142.131:41543/ using document root <none> and password file <none>
I20260811 07:19:20.093474 1884 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:20.093536 1884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:20.094987 1884 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:20.095822 1908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.096035 1884 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:20.096210 1884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "4260f9d05e0849a79e330f4cf7b06519"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "59c2de62179fe66ebcb5a2215e4e8176"
server_key_iv: "62fbd13eed7379db52f70c5b00643bcf"
server_key_version: "encryptionkey@0"
I20260811 07:19:20.096590 1884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:20.108877 1884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:20.111178 1884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:20.111310 1884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:20.111523 1884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:20.111908 1884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:20.111951 1884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.111976 1884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:20.111991 1884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.118464 1884 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:41317
I20260811 07:19:20.118546 2081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:41317 every 8 connection(s)
I20260811 07:19:20.118924 1884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
Aug 11 07:19:20 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432760, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:20.127857 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 1884
I20260811 07:19:20.128545 1664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.119724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:53029 (local address 127.9.142.190:35847)
0811 07:19:20.119813 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:20.119815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:20.120031 (+ 216us) server_negotiation.cc:407] Connection header received
0811 07:19:20.120592 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:20.120593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:20.120606 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:20.120656 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:20.121621 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.122131 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.123129 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.123340 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.123417 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.125589 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:20.125590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:20.125590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:20.125597 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:20.126983 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:20.127386 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:20.127386 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:20.127387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:20.127442 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:20.127804 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:20.127805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:20.127805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:20.127931 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:20.128018 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:20.128341 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 07:19:20.128453 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:19:20.128712 2084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.119705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:53029)
0811 07:19:20.119907 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.119944 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:20.120480 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:20.120737 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:20.120741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:20.121316 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:20.121514 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.121519 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.122236 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.122238 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.123032 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.123035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.123434 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.123436 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.123566 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.124065 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:20.124073 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:20.125486 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:20.127079 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:20.127086 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:20.127087 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:20.127314 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:20.127524 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:20.127525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:20.127526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:20.127660 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:20.128039 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:20.128049 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:20.128171 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 07:19:20.128300 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 07:19:20.128467 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":117,"threads_started":1}
I20260811 07:19:20.129242 2082 heartbeater.cc:347] Connected to a master server at 127.9.142.190:35847
I20260811 07:19:20.129347 2082 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:20.129554 2082 heartbeater.cc:511] Master 127.9.142.190:35847 requested a full tablet report, sending...
I20260811 07:19:20.129994 1338 ts_manager.cc:194] Registered new tserver with Master: 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317)
I20260811 07:19:20.130462 1338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:53029
I20260811 07:19:20.135064 2085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.128300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45626 (local address 127.9.142.190:35847)
0811 07:19:20.128453 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:20.128455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:20.128511 (+ 56us) server_negotiation.cc:407] Connection header received
0811 07:19:20.128698 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:20.128699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:20.128711 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:20.128794 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:20.129668 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.130349 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.131144 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.131400 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.131458 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.132617 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:20.132618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:20.132619 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:20.132640 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:20.134067 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:20.134411 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:20.134412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:20.134412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:20.134467 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:20.134630 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:20.134630 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:20.134630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:20.134716 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:20.134851 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:20.134887 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 07:19:20.134950 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
I20260811 07:19:20.135845 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:19:20.138447 2085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.136179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45628 (local address 127.9.142.190:35847)
0811 07:19:20.136216 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:20.136218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:20.136324 (+ 106us) server_negotiation.cc:407] Connection header received
0811 07:19:20.136370 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:20.136371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:20.136398 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:20.136452 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:19:20.136519 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.136956 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.137708 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.137903 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.137963 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.138093 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:19:20.138178 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:19:20.138241 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:20.138322 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 07:19:20.138341 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 07:19:20.138754 1338 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:45628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:19:20.140493 1338 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:19:20.142668 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 33fa231abee4420487cf1d0a73c70029 (DEFAULT_TABLE table=test-table [id=a89c0934edfa4559b68cb84c90a29642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:20.142894 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33fa231abee4420487cf1d0a73c70029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:20.144375 1481 tablet_bootstrap.cc:492] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Bootstrap starting.
I20260811 07:19:20.144752 1481 tablet_bootstrap.cc:654] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:20.145396 1481 tablet_bootstrap.cc:492] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: No bootstrap required, opened a new log
I20260811 07:19:20.145450 1481 ts_tablet_manager.cc:1397] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:20.145785 1481 raft_consensus.cc:348] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.145889 1481 raft_consensus.cc:374] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:20.145947 1481 raft_consensus.cc:729] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cc0bc5284c845a0ac273af2983dda85, State: Initialized, Role: FOLLOWER
I20260811 07:19:20.145992 1481 consensus_queue.cc:260] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.146099 1481 ts_tablet_manager.cc:1428] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:20.146478 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.142431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:38043 (local address 127.0.0.1:45206)
0811 07:19:20.142566 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.142578 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:20.142631 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:20.143064 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:20.143066 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:20.143068 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:20.143112 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.143114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.144221 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.144222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.145256 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.145259 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.146224 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.146225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.146285 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.146318 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:19:20.146370 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 07:19:20.146407 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260811 07:19:20.146700 2094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.142683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45206 (local address 127.9.142.130:38043)
0811 07:19:20.142883 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:20.142887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:20.142897 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:19:20.142943 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:20.142945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:20.142958 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:20.143051 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:20.143179 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.144115 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.145406 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.146067 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.146134 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.146189 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:20.146580 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 07:19:20.146623 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":128,"threads_started":1}
I20260811 07:19:20.147246 1769 tablet_service.cc:1467] Processing CreateTablet for tablet 33fa231abee4420487cf1d0a73c70029 (DEFAULT_TABLE table=test-table [id=a89c0934edfa4559b68cb84c90a29642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:20.147583 1769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33fa231abee4420487cf1d0a73c70029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:20.148043 1668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.142344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:41317 (local address 127.0.0.1:50848)
0811 07:19:20.142379 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.142391 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:20.142430 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:20.144626 (+ 2196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:20.144627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:20.144629 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:20.144661 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.144663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.145870 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.145871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.146907 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.146910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.147828 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.147830 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.147905 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.147909 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:20.147958 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 07:19:20.147997 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 07:19:20.148089 2092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.142476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50848 (local address 127.9.142.131:41317)
0811 07:19:20.144468 (+ 1992us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:20.144472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:20.144483 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:19:20.144521 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:20.144523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:20.144543 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:20.144629 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:20.144723 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.145761 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.146998 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.147717 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.147815 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.147873 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:20.147973 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 07:19:20.148015 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1957,"thread_start_us":97,"threads_started":1}
I20260811 07:19:20.148718 1983 tablet_service.cc:1467] Processing CreateTablet for tablet 33fa231abee4420487cf1d0a73c70029 (DEFAULT_TABLE table=test-table [id=a89c0934edfa4559b68cb84c90a29642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:20.149037 1983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33fa231abee4420487cf1d0a73c70029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:20.149628 1703 tablet_bootstrap.cc:492] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: Bootstrap starting.
I20260811 07:19:20.150322 1703 tablet_bootstrap.cc:654] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:20.150686 1703 log.cc:824] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:20.151386 1703 tablet_bootstrap.cc:492] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: No bootstrap required, opened a new log
I20260811 07:19:20.151465 1703 ts_tablet_manager.cc:1397] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 07:19:20.152474 2100 tablet_bootstrap.cc:492] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: Bootstrap starting.
I20260811 07:19:20.153214 2100 tablet_bootstrap.cc:654] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:20.153422 1703 raft_consensus.cc:348] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.153611 1703 raft_consensus.cc:374] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:20.153690 1703 raft_consensus.cc:729] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 217ec754de3c4bdaa40ce3e0208459ac, State: Initialized, Role: FOLLOWER
I20260811 07:19:20.153831 1703 consensus_queue.cc:260] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.153923 2100 log.cc:824] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:20.154142 1703 ts_tablet_manager.cc:1428] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:19:20.154285 1881 heartbeater.cc:503] Master 127.9.142.190:35847 was elected leader, sending a full tablet report...
I20260811 07:19:20.154708 2100 tablet_bootstrap.cc:492] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: No bootstrap required, opened a new log
I20260811 07:19:20.154795 2100 ts_tablet_manager.cc:1397] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:20.156431 2100 raft_consensus.cc:348] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.156560 2100 raft_consensus.cc:374] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:20.156582 2100 raft_consensus.cc:729] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4260f9d05e0849a79e330f4cf7b06519, State: Initialized, Role: FOLLOWER
I20260811 07:19:20.156700 2100 consensus_queue.cc:260] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.156981 2100 ts_tablet_manager.cc:1428] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:20.157068 2082 heartbeater.cc:503] Master 127.9.142.190:35847 was elected leader, sending a full tablet report...
W20260811 07:19:20.236003 1882 tablet.cc:2369] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:19:20.323858 1662 tablet.cc:2369] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:19:20.330765 1667 raft_consensus.cc:482] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:20.330881 1667 raft_consensus.cc:504] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.331219 1667 leader_election.cc:288] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317), 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043)
I20260811 07:19:20.334335 1663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.331421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:41317 (local address 127.9.142.129:40765)
0811 07:19:20.331500 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.331514 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:20.331580 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:20.331812 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:20.331813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:20.331815 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:20.331896 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.331898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.332594 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.332595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.333415 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.333418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.334064 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.334065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.334150 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.334176 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 07:19:20.334230 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 07:19:20.334279 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":30}
I20260811 07:19:20.334376 2092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.331598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:40765 (local address 127.9.142.131:41317)
0811 07:19:20.331644 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:20.331646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:20.331654 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:19:20.331685 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:20.331685 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:20.331696 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:20.331797 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:20.331987 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.332507 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.333501 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.333975 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.334032 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.334039 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:20.334253 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 07:19:20.334295 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:19:20.334596 2094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.331569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:57507 (local address 127.9.142.130:38043)
0811 07:19:20.331615 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:20.331617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:20.331628 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:19:20.331705 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:20.331706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:20.331715 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:20.331806 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:20.332063 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.332533 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.333708 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.334141 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.334220 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.334229 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:20.334478 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 07:19:20.334526 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:19:20.334830 2104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.331438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:38043 (local address 127.9.142.129:57507)
0811 07:19:20.331565 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.331577 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:20.331634 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:20.331834 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:20.331836 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:20.331838 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:20.331976 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.331979 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.332645 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.332646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.333614 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:20.333618 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.334276 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.334277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:20.334368 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.334372 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:20.334710 (+ 338us) client_negotiation.cc:240] Negotiation successful
0811 07:19:20.334758 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":1,"thread_start_us":72,"threads_started":1}
I20260811 07:19:20.334764 2009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33fa231abee4420487cf1d0a73c70029" candidate_uuid: "3cc0bc5284c845a0ac273af2983dda85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4260f9d05e0849a79e330f4cf7b06519" is_pre_election: true
I20260811 07:19:20.334960 2009 raft_consensus.cc:2454] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cc0bc5284c845a0ac273af2983dda85 in term 0.
I20260811 07:19:20.335201 1470 leader_election.cc:302] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cc0bc5284c845a0ac273af2983dda85, 4260f9d05e0849a79e330f4cf7b06519; no voters:
I20260811 07:19:20.335251 1799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33fa231abee4420487cf1d0a73c70029" candidate_uuid: "3cc0bc5284c845a0ac273af2983dda85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "217ec754de3c4bdaa40ce3e0208459ac" is_pre_election: true
I20260811 07:19:20.335358 1667 raft_consensus.cc:2781] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:19:20.335414 1667 raft_consensus.cc:482] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:19:20.335408 1799 raft_consensus.cc:2454] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cc0bc5284c845a0ac273af2983dda85 in term 0.
I20260811 07:19:20.335448 1667 raft_consensus.cc:3037] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:20.336279 1667 raft_consensus.cc:504] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.336449 1667 leader_election.cc:288] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 1 election: Requested vote from peers 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317), 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043)
I20260811 07:19:20.336620 2009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33fa231abee4420487cf1d0a73c70029" candidate_uuid: "3cc0bc5284c845a0ac273af2983dda85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4260f9d05e0849a79e330f4cf7b06519"
I20260811 07:19:20.336642 1799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33fa231abee4420487cf1d0a73c70029" candidate_uuid: "3cc0bc5284c845a0ac273af2983dda85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "217ec754de3c4bdaa40ce3e0208459ac"
I20260811 07:19:20.336709 2009 raft_consensus.cc:3037] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:20.336720 1799 raft_consensus.cc:3037] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:20.337435 2009 raft_consensus.cc:2454] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cc0bc5284c845a0ac273af2983dda85 in term 1.
I20260811 07:19:20.337519 1799 raft_consensus.cc:2454] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cc0bc5284c845a0ac273af2983dda85 in term 1.
I20260811 07:19:20.337625 1470 leader_election.cc:302] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cc0bc5284c845a0ac273af2983dda85, 4260f9d05e0849a79e330f4cf7b06519; no voters:
I20260811 07:19:20.337720 1667 raft_consensus.cc:2781] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:20.337939 1667 raft_consensus.cc:686] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 LEADER]: Becoming Leader. State: Replica: 3cc0bc5284c845a0ac273af2983dda85, State: Running, Role: LEADER
I20260811 07:19:20.338034 1667 consensus_queue.cc:237] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.338864 1338 catalog_manager.cc:5495] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cc0bc5284c845a0ac273af2983dda85 (127.9.142.129). New cstate: current_term: 1 leader_uuid: "3cc0bc5284c845a0ac273af2983dda85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } health_report { overall_health: HEALTHY } } }
W20260811 07:19:20.369553 2083 tablet.cc:2369] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:19:20.377645 2110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.373831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58806 (local address 127.9.142.129:33353)
0811 07:19:20.373968 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:20.373970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:20.373978 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:19:20.374022 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:20.374022 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:20.374065 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:20.374169 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:19:20.374315 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.375192 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.376542 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:20.376907 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:20.376995 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:20.377187 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:19:20.377356 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:19:20.377445 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:20.377505 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 07:19:20.377527 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260811 07:19:20.379556 2009 raft_consensus.cc:1261] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [term 1 FOLLOWER]: Refusing update from remote peer 3cc0bc5284c845a0ac273af2983dda85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:20.379559 1799 raft_consensus.cc:1261] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [term 1 FOLLOWER]: Refusing update from remote peer 3cc0bc5284c845a0ac273af2983dda85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:20.379925 1667 consensus_queue.cc:1035] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:20.380074 1667 consensus_queue.cc:1035] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:20.384863 2111 mvcc.cc:205] Tried to move back new op lower bound from 7317228586512031744 to 7317228586345320448. Current Snapshot: MvccSnapshot[applied={T|T < 7317228586512031744}]
I20260811 07:19:20.385139 2112 mvcc.cc:205] Tried to move back new op lower bound from 7317228586512031744 to 7317228586345320448. Current Snapshot: MvccSnapshot[applied={T|T < 7317228586512031744}]
I20260811 07:19:20.386287 2116 mvcc.cc:205] Tried to move back new op lower bound from 7317228586512031744 to 7317228586345320448. Current Snapshot: MvccSnapshot[applied={T|T < 7317228586512031744}]
I20260811 07:19:20.387364 1338 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:45628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:20.387460 1338 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:45628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:20.388270 1338 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Sending DeleteTablet for 3 replicas of tablet 33fa231abee4420487cf1d0a73c70029
I20260811 07:19:20.388679 1553 tablet_service.cc:1514] Processing DeleteTablet for tablet 33fa231abee4420487cf1d0a73c70029 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:20 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:58802
I20260811 07:19:20.388669 1983 tablet_service.cc:1514] Processing DeleteTablet for tablet 33fa231abee4420487cf1d0a73c70029 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:20 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:50848
I20260811 07:19:20.388909 2131 tablet_replica.cc:330] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: stopping tablet replica
I20260811 07:19:20.389050 2131 raft_consensus.cc:2229] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:20.389067 1769 tablet_service.cc:1514] Processing DeleteTablet for tablet 33fa231abee4420487cf1d0a73c70029 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:20 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:45206
I20260811 07:19:20.389099 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 1399
I20260811 07:19:20.389166 2131 raft_consensus.cc:2258] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:20.393594 2131 ts_tablet_manager.cc:1905] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:20.394186 2134 tablet_replica.cc:330] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: stopping tablet replica
I20260811 07:19:20.394323 2134 raft_consensus.cc:2229] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:20.394434 2134 raft_consensus.cc:2258] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:20.394816 2134 ts_tablet_manager.cc:1905] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:20.395833 2131 ts_tablet_manager.cc:1918] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:20.395942 2131 log.cc:1196] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/33fa231abee4420487cf1d0a73c70029
I20260811 07:19:20.396277 2134 ts_tablet_manager.cc:1918] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:20.396312 2131 ts_tablet_manager.cc:1939] T 33fa231abee4420487cf1d0a73c70029 P 4260f9d05e0849a79e330f4cf7b06519: Deleting consensus metadata
I20260811 07:19:20.396329 2134 log.cc:1196] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/33fa231abee4420487cf1d0a73c70029
I20260811 07:19:20.396528 2134 ts_tablet_manager.cc:1939] T 33fa231abee4420487cf1d0a73c70029 P 217ec754de3c4bdaa40ce3e0208459ac: Deleting consensus metadata
I20260811 07:19:20.396812 1308 catalog_manager.cc:4841] TS 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317): tablet 33fa231abee4420487cf1d0a73c70029 (table test-table [id=a89c0934edfa4559b68cb84c90a29642]) successfully deleted
I20260811 07:19:20.396991 1311 catalog_manager.cc:4841] TS 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043): tablet 33fa231abee4420487cf1d0a73c70029 (table test-table [id=a89c0934edfa4559b68cb84c90a29642]) successfully deleted
W20260811 07:19:20.405128 1310 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:33353 (error 108)
I20260811 07:19:20.405539 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 1665
I20260811 07:19:20.405732 1668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.405554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33353 (local address 127.0.0.1:58808)
0811 07:19:20.405643 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.405690 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 07:19:20.409217 1310 catalog_manager.cc:4584] TS 3cc0bc5284c845a0ac273af2983dda85 (127.9.142.129:33353): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 33fa231abee4420487cf1d0a73c70029: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33353: connect: Connection refused (error 111)
I20260811 07:19:20.418308 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 1884
I20260811 07:19:20.430007 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 1276
I20260811 07:19:20.438619 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35847
--webserver_interface=127.9.142.190
--webserver_port=42367
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:35847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:20.525205 2137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:20.525444 2137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:20.525482 2137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:20.526618 2137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:20.526682 2137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:20.526710 2137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:20.526741 2137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:20.526793 2137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:20.528398 2137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:35847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=42367
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:20.528677 2137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:20.528911 2137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:20.533892 2153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:20.533892 2148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:20.534157 2137 server_base.cc:1034] running on GCE node
W20260811 07:19:20.533933 2149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:20.534471 2137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:20.534735 2137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:20.535915 2137 hybrid_clock.cc:648] HybridClock initialized: now 1786432760535910 us; error 34 us; skew 500 ppm
Aug 11 07:19:20 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432760, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:20.538425 2137 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:19:20.538841 2137 webserver.cc:460] Webserver started at http://127.9.142.190:42367/ using document root <none> and password file <none>
I20260811 07:19:20.539070 2137 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:20.539142 2137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:20.540544 2137 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:20.541210 2165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.541386 2137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:19:20.541498 2137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "ca86663743804545a6e7a5d6a5843e69"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "fafe5a560070f3837b0bad49b6039a92"
server_key_iv: "084fba0eeb24103f6ef8f16af2e9dd41"
server_key_version: "encryptionkey@0"
I20260811 07:19:20.541843 2137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:20.552345 2137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:20.554605 2137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:20.554766 2137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:20.558892 2137 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:35847
I20260811 07:19:20.558939 2257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:35847 every 8 connection(s)
I20260811 07:19:20.559330 2137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:19:20.561019 2260 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:19:20.561746 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Bootstrap starting.
I20260811 07:19:20.564254 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 2137
I20260811 07:19:20.564553 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:33353
--local_ip_for_outbound_sockets=127.9.142.129
--tserver_master_addrs=127.9.142.190:35847
--webserver_port=39425
--webserver_interface=127.9.142.129
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:19:20.571595 2260 log.cc:824] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:20.574204 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:19:20.574546 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69: Bootstrap complete.
I20260811 07:19:20.577093 2260 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:20.577350 2260 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86663743804545a6e7a5d6a5843e69, State: Initialized, Role: FOLLOWER
I20260811 07:19:20.577569 2260 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:20.577668 2260 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:19:20.577724 2260 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:19:20.577773 2260 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:19:20.578790 2260 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:20.578918 2260 leader_election.cc:302] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca86663743804545a6e7a5d6a5843e69; no voters:
I20260811 07:19:20.579133 2260 leader_election.cc:288] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 07:19:20.579200 2265 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:19:20.579334 2265 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [term 3 LEADER]: Becoming Leader. State: Replica: ca86663743804545a6e7a5d6a5843e69, State: Running, Role: LEADER
I20260811 07:19:20.579428 2260 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:19:20.579438 2265 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } }
I20260811 07:19:20.579802 2266 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ca86663743804545a6e7a5d6a5843e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } } }
I20260811 07:19:20.579798 2265 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca86663743804545a6e7a5d6a5843e69. Latest consensus state: current_term: 3 leader_uuid: "ca86663743804545a6e7a5d6a5843e69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca86663743804545a6e7a5d6a5843e69" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35847 } } }
I20260811 07:19:20.579912 2266 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:20.579932 2265 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca86663743804545a6e7a5d6a5843e69 [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:20.580543 2277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:19:20.581413 2277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:19:20.581573 2277 catalog_manager.cc:1259] Loaded cluster ID: 097589adb3644df29e8b87e00b89e449
I20260811 07:19:20.581837 2277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 07:19:20.582185 2277 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f75c23909ad google::LogMessage::Fail() at ??:0
@ 0x7f75c239388a google::LogMessage::SendToLog() at ??:0
@ 0x7f75c23904de google::LogMessage::Flush() at ??:0
@ 0x7f75c2391a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f75ca2b10f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f75ca2ba8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f75c425e0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f75c4253954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f75c50b76db start_thread at ??:0
@ 0x7f75c0e8e61f clone at ??:0
W20260811 07:19:20.666157 2263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:20.666414 2263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:20.666460 2263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:20.667841 2263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:20.667917 2263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:20.667970 2263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:19:20.669644 2263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:33353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=39425
--tserver_master_addrs=127.9.142.190:35847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:20.669925 2263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:20.670193 2263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:20.676164 2334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:20.676312 2336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:20.676419 2263 server_base.cc:1034] running on GCE node
W20260811 07:19:20.676551 2341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:20.676770 2263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:20.677062 2263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:20.678233 2263 hybrid_clock.cc:648] HybridClock initialized: now 1786432760678220 us; error 31 us; skew 500 ppm
Aug 11 07:19:20 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432760, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:20.681217 2263 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:19:20.681658 2263 webserver.cc:460] Webserver started at http://127.9.142.129:39425/ using document root <none> and password file <none>
I20260811 07:19:20.681890 2263 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:20.681969 2263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:20.683368 2263 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:20.684250 2350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.684439 2263 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:20.684542 2263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "3cc0bc5284c845a0ac273af2983dda85"
format_stamp: "Formatted at 2026-08-11 07:19:18 on dist-test-slave-7f01"
server_key: "71690c31754a9489fc0a74edbb73b8d5"
server_key_iv: "b692ab1048ee14170a22066af4c8182f"
server_key_version: "encryptionkey@0"
I20260811 07:19:20.684902 2263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:20.700899 2263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:20.703248 2263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:20.703423 2263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:20.703662 2263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:20.704190 2361 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:19:20.706135 2263 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:19:20.706218 2263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 07:19:20.706270 2263 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:19:20.707357 2263 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:19:20.707501 2361 tablet_bootstrap.cc:492] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Bootstrap starting.
I20260811 07:19:20.707528 2263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:20.715642 2263 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:33353
I20260811 07:19:20.715886 2567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:33353 every 8 connection(s)
I20260811 07:19:20.716171 2263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:19:20.720624 2361 log.cc:824] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:20.721344 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 2263
I20260811 07:19:20.721757 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:38043
--local_ip_for_outbound_sockets=127.9.142.130
--tserver_master_addrs=127.9.142.190:35847
--webserver_port=44437
--webserver_interface=127.9.142.130
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:19:20.723963 2361 tablet_bootstrap.cc:492] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:19:20.724252 2361 tablet_bootstrap.cc:492] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Bootstrap complete.
I20260811 07:19:20.725291 2361 ts_tablet_manager.cc:1397] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.008s
I20260811 07:19:20.726336 2361 raft_consensus.cc:348] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.726591 2361 raft_consensus.cc:729] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cc0bc5284c845a0ac273af2983dda85, State: Initialized, Role: FOLLOWER
I20260811 07:19:20.726794 2361 consensus_queue.cc:260] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:20.727115 2361 ts_tablet_manager.cc:1428] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260811 07:19:20.810084 2576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:20.810299 2576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:20.810341 2576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:20.811496 2576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:20.811564 2576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:20.811609 2576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:19:20.813107 2576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:38043
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=44437
--tserver_master_addrs=127.9.142.190:35847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:20.813378 2576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:20.813627 2576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:20.818748 2595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:20.818743 2589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:20.819115 2590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:20.819231 2576 server_base.cc:1034] running on GCE node
I20260811 07:19:20.819469 2576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:20.819777 2576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:20.820957 2576 hybrid_clock.cc:648] HybridClock initialized: now 1786432760820943 us; error 28 us; skew 500 ppm
Aug 11 07:19:20 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432760, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:20.824626 2576 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:19:20.825470 2576 webserver.cc:460] Webserver started at http://127.9.142.130:44437/ using document root <none> and password file <none>
I20260811 07:19:20.825703 2576 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:20.825742 2576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:20.827039 2576 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:20.827682 2611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.827925 2576 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:20.828028 2576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "217ec754de3c4bdaa40ce3e0208459ac"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "498f5c9df50dbb24559a144c12a19607"
server_key_iv: "95c4a525d3824ba8671c83f9e37749ce"
server_key_version: "encryptionkey@0"
I20260811 07:19:20.828513 2576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260811 07:19:20.831418 2573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:19:20.716933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:44785)
0811 07:19:20.717123 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.717167 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:20.717906 (+ 739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:20.831202 (+113296us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
W20260811 07:19:20.831722 2569 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:35847 (0 consecutive failures): Network error: Failed to ping master at 127.9.142.190:35847: Client connection negotiation failed: client connection to 127.9.142.190:35847: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:19:20.832110 2573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.831986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:60693)
0811 07:19:20.832043 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.832081 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 07:19:20.832460 2573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.832372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:46295)
0811 07:19:20.832417 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.832445 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 07:19:20.832590 2569 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:19:20.845824 2576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:20.848109 2576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:20.848219 2576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:20.848397 2576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:20.848706 2576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:20.848743 2576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.848764 2576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:20.848811 2576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.854631 2576 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:38043
I20260811 07:19:20.854727 2819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:38043 every 8 connection(s)
I20260811 07:19:20.855051 2576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:19:20.856104 2823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.855703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:52959)
0811 07:19:20.855909 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.855976 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":125,"threads_started":1}
W20260811 07:19:20.856495 2820 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:35847 (0 consecutive failures): Network error: Failed to ping master at 127.9.142.190:35847: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
I20260811 07:19:20.856776 2823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.856678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:43587)
0811 07:19:20.856726 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.856751 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 07:19:20.857056 2823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.856969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:54069)
0811 07:19:20.857013 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.857035 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 07:19:20.857163 2820 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:19:20.860246 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 2576
I20260811 07:19:20.860510 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:41317
--local_ip_for_outbound_sockets=127.9.142.131
--tserver_master_addrs=127.9.142.190:35847
--webserver_port=41543
--webserver_interface=127.9.142.131
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:20.945391 2825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:20.945632 2825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:20.945676 2825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:20.946820 2825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:20.946893 2825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:20.946940 2825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:19:20.948431 2825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:41317
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=41543
--tserver_master_addrs=127.9.142.190:35847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:20.948686 2825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:20.948920 2825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:20.953858 2838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:20.953907 2835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:20.954131 2825 server_base.cc:1034] running on GCE node
W20260811 07:19:20.953907 2842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:20.954414 2825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:20.954649 2825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:20.955803 2825 hybrid_clock.cc:648] HybridClock initialized: now 1786432760955792 us; error 28 us; skew 500 ppm
Aug 11 07:19:20 dist-test-slave-7f01 krb5kdc[409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432760, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:20.958189 2825 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:19:20.958662 2825 webserver.cc:460] Webserver started at http://127.9.142.131:41543/ using document root <none> and password file <none>
I20260811 07:19:20.958914 2825 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:20.958987 2825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:20.960379 2825 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:19:20.960970 2850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.961144 2825 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:19:20.961256 2825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "4260f9d05e0849a79e330f4cf7b06519"
format_stamp: "Formatted at 2026-08-11 07:19:19 on dist-test-slave-7f01"
server_key: "59c2de62179fe66ebcb5a2215e4e8176"
server_key_iv: "62fbd13eed7379db52f70c5b00643bcf"
server_key_version: "encryptionkey@0"
I20260811 07:19:20.961582 2825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:20.973821 2825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:20.975723 2825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:20.975921 2825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:20.976199 2825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:20.976523 2825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:20.976580 2825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.976621 2825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:20.976650 2825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:20.982854 2825 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:41317
I20260811 07:19:20.982908 3042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:41317 every 8 connection(s)
I20260811 07:19:20.983240 2825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:19:20.984418 3048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.983937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:59329)
0811 07:19:20.984197 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.984269 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":86,"threads_started":1}
W20260811 07:19:20.984828 3044 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:35847 (0 consecutive failures): Network error: Failed to ping master at 127.9.142.190:35847: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
I20260811 07:19:20.985140 3048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.985048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:43239)
0811 07:19:20.985093 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.985121 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 07:19:20.985376 3048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:20.985323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:46385)
0811 07:19:20.985346 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:20.985365 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260811 07:19:20.985489 3044 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:19:20.986177 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 2825
I20260811 07:19:21.833165 3050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:21.832933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:56559)
0811 07:19:21.833055 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:21.833093 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260811 07:19:21.857723 3052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:21.857499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:55909)
0811 07:19:21.857637 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:21.857670 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260811 07:19:21.985976 3053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:21.985779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:58433)
0811 07:19:21.985894 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:21.985927 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":55,"threads_started":1}
I20260811 07:19:22.523725 3054 raft_consensus.cc:482] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:22.523970 3054 raft_consensus.cc:504] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:22.524343 3054 leader_election.cc:288] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317), 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043)
Aug 11 07:19:22 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432760, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.130@KRBTEST.COM
Aug 11 07:19:22 dist-test-slave-7f01 krb5kdc[409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432760, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.131@KRBTEST.COM
I20260811 07:19:22.535300 3058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:22.524623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:37315 (local address 127.9.142.130:38043)
0811 07:19:22.524806 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:22.524818 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:22.524846 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:19:22.525321 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:22.525324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:22.525366 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:22.525641 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:22.526402 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:22.527285 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:22.528365 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:22.528770 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:22.528896 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:22.531355 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:22.531359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:22.531359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:22.531369 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:22.533567 (+ 2198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:22.534059 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:22.534062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:22.534063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:22.534163 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:22.534428 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:22.534429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:22.534430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:22.534666 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:22.534754 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:22.535055 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 07:19:22.535176 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":64,"threads_started":1}
I20260811 07:19:22.535287 3056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:22.524545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:38043 (local address 127.9.142.129:37315)
0811 07:19:22.524643 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:22.524655 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:22.524715 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:22.525663 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:22.525666 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:22.526078 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:22.526272 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:22.526278 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:22.527395 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:22.527396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:22.528275 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:22.528278 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:22.528869 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:22.528871 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:22.528991 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:22.529653 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:22.529658 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:22.531201 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:22.533645 (+ 2444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:22.533653 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:22.533655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:22.533973 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:22.534232 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:22.534233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:22.534234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:22.534353 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:22.534747 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:22.534754 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:22.534877 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 07:19:22.534989 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 07:19:22.535184 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":34,"thread_start_us":44,"threads_started":1}
I20260811 07:19:22.535379 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:22.524730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:39145 (local address 127.9.142.131:41317)
0811 07:19:22.524876 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:22.524893 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:22.524914 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:19:22.525333 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:22.525335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:22.525449 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:22.525630 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:22.526412 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:22.527292 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:22.528384 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:22.528771 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:22.528897 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:22.531607 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:22.531611 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:22.531611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:22.531623 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:22.533548 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:22.534060 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:22.534063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:22.534063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:22.534165 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:22.534424 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:22.534425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:22.534426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:22.534666 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:22.534754 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:22.535044 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 07:19:22.535178 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":60,"threads_started":1}
I20260811 07:19:22.535563 3055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:22.524518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:41317 (local address 127.9.142.129:39145)
0811 07:19:22.524644 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:22.524655 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:22.524715 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:22.525662 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:22.525665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:22.526079 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:22.526272 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:22.526278 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:22.527404 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:22.527405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:22.528275 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:22.528277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:22.528867 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:22.528868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:22.528983 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:22.529623 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:22.529632 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:22.531504 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:22.533657 (+ 2153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:22.533658 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:22.533659 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:22.533973 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:22.534242 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:22.534243 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:22.534244 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:22.534355 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:22.534747 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:22.534754 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:22.534878 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 07:19:22.534986 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:19:22.535270 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":178,"thread_start_us":65,"threads_started":1}
W20260811 07:19:22.536399 2355 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
W20260811 07:19:22.536471 2351 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
I20260811 07:19:22.536500 2355 leader_election.cc:302] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cc0bc5284c845a0ac273af2983dda85; no voters: 217ec754de3c4bdaa40ce3e0208459ac, 4260f9d05e0849a79e330f4cf7b06519
I20260811 07:19:22.536659 3054 raft_consensus.cc:2726] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:19:22.833828 3055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:22.833666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:42431)
0811 07:19:22.833724 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:22.833763 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 07:19:22.858654 3062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:22.858353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:55769)
0811 07:19:22.858538 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:22.858602 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":92,"threads_started":1}
I20260811 07:19:22.986843 3064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:22.986563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:44505)
0811 07:19:22.986730 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:22.986788 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":91,"threads_started":1}
I20260811 07:19:23.834550 3067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:23.834311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:33031)
0811 07:19:23.834457 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:23.834497 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260811 07:19:23.859405 3068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:23.859173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:59911)
0811 07:19:23.859322 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:23.859354 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
I20260811 07:19:23.987524 3070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:23.987323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:45219)
0811 07:19:23.987448 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:23.987483 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
I20260811 07:19:24.210742 3072 raft_consensus.cc:482] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:24.210891 3072 raft_consensus.cc:504] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:24.211113 3072 leader_election.cc:288] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317), 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043)
W20260811 07:19:24.211859 2351 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
W20260811 07:19:24.212062 2355 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
I20260811 07:19:24.212155 2355 leader_election.cc:302] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cc0bc5284c845a0ac273af2983dda85; no voters: 217ec754de3c4bdaa40ce3e0208459ac, 4260f9d05e0849a79e330f4cf7b06519
I20260811 07:19:24.212329 3072 raft_consensus.cc:2726] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:19:24.835327 3074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:24.835028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:53319)
0811 07:19:24.835190 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:24.835232 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":88,"threads_started":1}
I20260811 07:19:24.860280 3075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:24.860051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:49379)
0811 07:19:24.860202 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:24.860238 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":66,"threads_started":1}
I20260811 07:19:24.988242 3076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:24.988031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:46089)
0811 07:19:24.988152 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:24.988190 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":74,"threads_started":1}
I20260811 07:19:25.836083 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:25.835864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:56409)
0811 07:19:25.835994 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:25.836033 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260811 07:19:25.861057 3079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:25.860779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:48303)
0811 07:19:25.860962 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:25.861009 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":102,"threads_started":1}
I20260811 07:19:25.989058 3080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:25.988756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:48213)
0811 07:19:25.988974 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:25.989008 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":148,"threads_started":1}
I20260811 07:19:26.694173 3081 raft_consensus.cc:482] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:26.694279 3081 raft_consensus.cc:504] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:26.694451 3081 leader_election.cc:288] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317), 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043)
W20260811 07:19:26.694872 2351 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
W20260811 07:19:26.694945 2355 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
I20260811 07:19:26.695041 2355 leader_election.cc:302] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cc0bc5284c845a0ac273af2983dda85; no voters: 217ec754de3c4bdaa40ce3e0208459ac, 4260f9d05e0849a79e330f4cf7b06519
I20260811 07:19:26.695123 3081 raft_consensus.cc:2726] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:19:26.836848 3082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:26.836622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:55265)
0811 07:19:26.836757 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:26.836795 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":72,"threads_started":1}
I20260811 07:19:26.861816 3083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:26.861617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:48685)
0811 07:19:26.861745 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:26.861776 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260811 07:19:26.989786 3085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:26.989502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:42663)
0811 07:19:26.989664 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:26.989733 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":67,"threads_started":1}
I20260811 07:19:27.837574 3087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:27.837344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:56371)
0811 07:19:27.837478 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:27.837518 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260811 07:19:27.862537 3088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:27.862278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:49893)
0811 07:19:27.862458 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:27.862492 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":124,"threads_started":1}
I20260811 07:19:27.990513 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:27.990275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:50129)
0811 07:19:27.990433 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:27.990471 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":79,"threads_started":1}
I20260811 07:19:28.838593 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:28.838239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:46245)
0811 07:19:28.838446 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:28.838518 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":78,"threads_started":1}
I20260811 07:19:28.863276 3094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:28.863056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:43401)
0811 07:19:28.863194 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:28.863231 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":70,"threads_started":1}
I20260811 07:19:28.991178 3095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:28.990955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:52649)
0811 07:19:28.991102 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:28.991138 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":78,"threads_started":1}
I20260811 07:19:29.468510 3099 raft_consensus.cc:482] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:29.468626 3099 raft_consensus.cc:504] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:29.468818 3099 leader_election.cc:288] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317), 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043)
W20260811 07:19:29.469254 2351 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
W20260811 07:19:29.469345 2355 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
I20260811 07:19:29.469453 2355 leader_election.cc:302] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cc0bc5284c845a0ac273af2983dda85; no voters: 217ec754de3c4bdaa40ce3e0208459ac, 4260f9d05e0849a79e330f4cf7b06519
I20260811 07:19:29.469537 3099 raft_consensus.cc:2726] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:19:29.839432 3100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:29.839185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:46613)
0811 07:19:29.839326 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:29.839373 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":72,"threads_started":1}
I20260811 07:19:29.864109 3101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:29.863862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:45455)
0811 07:19:29.863991 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:29.864051 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260811 07:19:29.991894 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:29.991643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:34281)
0811 07:19:29.991794 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:29.991841 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":61,"threads_started":1}
I20260811 07:19:30.840591 3104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:30.840145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:46933)
0811 07:19:30.840308 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:30.840359 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":81,"threads_started":1}
I20260811 07:19:30.864827 3105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:30.864604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:51907)
0811 07:19:30.864741 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:30.864781 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260811 07:19:30.992594 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:30.992368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:33407)
0811 07:19:30.992517 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:30.992550 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260811 07:19:31.841414 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:31.841164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:53279)
0811 07:19:31.841314 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:31.841353 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":69,"threads_started":1}
I20260811 07:19:31.865574 3111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:31.865333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:38509)
0811 07:19:31.865488 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:31.865526 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":110,"threads_started":1}
I20260811 07:19:31.962191 3113 raft_consensus.cc:482] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:31.962311 3113 raft_consensus.cc:504] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4260f9d05e0849a79e330f4cf7b06519" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41317 } } peers { permanent_uuid: "217ec754de3c4bdaa40ce3e0208459ac" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 38043 } } peers { permanent_uuid: "3cc0bc5284c845a0ac273af2983dda85" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33353 } }
I20260811 07:19:31.962512 3113 leader_election.cc:288] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317), 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043)
W20260811 07:19:31.962936 2351 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4260f9d05e0849a79e330f4cf7b06519 (127.9.142.131:41317): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
W20260811 07:19:31.963040 2355 leader_election.cc:341] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 217ec754de3c4bdaa40ce3e0208459ac (127.9.142.130:38043): Not found: Tablet not found: 33fa231abee4420487cf1d0a73c70029
I20260811 07:19:31.963142 2355 leader_election.cc:302] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cc0bc5284c845a0ac273af2983dda85; no voters: 217ec754de3c4bdaa40ce3e0208459ac, 4260f9d05e0849a79e330f4cf7b06519
I20260811 07:19:31.963214 3113 raft_consensus.cc:2726] T 33fa231abee4420487cf1d0a73c70029 P 3cc0bc5284c845a0ac273af2983dda85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:19:31.993266 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:31.993043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:36947)
0811 07:19:31.993177 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:31.993214 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":67,"threads_started":1}
I20260811 07:19:32.842265 3117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:32.841947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:45121)
0811 07:19:32.842153 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:32.842206 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":86,"threads_started":1}
I20260811 07:19:32.866287 3122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:32.866013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:60377)
0811 07:19:32.866190 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:32.866233 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":95,"threads_started":1}
I20260811 07:19:32.993942 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:32.993716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:46449)
0811 07:19:32.993854 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:32.993893 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":65,"threads_started":1}
I20260811 07:19:33.843120 3124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:33.842847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:44387)
0811 07:19:33.843010 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:33.843052 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":71,"threads_started":1}
I20260811 07:19:33.866982 3125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:33.866724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:45599)
0811 07:19:33.866875 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:33.866910 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260811 07:19:33.994809 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:33.994579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:41305)
0811 07:19:33.994720 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:33.994760 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
I20260811 07:19:34.843992 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:34.843694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:41053)
0811 07:19:34.843888 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:34.843941 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":131,"threads_started":1}
I20260811 07:19:34.867889 3130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:34.867510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:50309)
0811 07:19:34.867717 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:34.867821 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":87,"threads_started":1}
I20260811 07:19:34.995576 3131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:34.995308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:43913)
0811 07:19:34.995466 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:34.995508 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":75,"threads_started":1}
I20260811 07:19:35.844807 3133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:35.844559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.129:42555)
0811 07:19:35.844719 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:35.844755 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":96,"threads_started":1}
I20260811 07:19:35.868626 3134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:35.868416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.130:55701)
0811 07:19:35.868554 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:35.868585 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
I20260811 07:19:35.995031 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 2263
I20260811 07:19:36.003566 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:35.999573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:35847 (local address 127.9.142.131:53713)
0811 07:19:36.003455 (+ 3882us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:36.003502 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:35847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3860,"thread_start_us":59,"threads_started":1}
I20260811 07:19:36.009723 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 2576
I20260811 07:19:36.024448 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 2825
2026-08-11T07:19:36Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18783 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:19:36 dist-test-slave-7f01 krb5kdc[3138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:19:36 dist-test-slave-7f01 krb5kdc[3138](info): set up 2 sockets
Aug 11 07:19:36 dist-test-slave-7f01 krb5kdc[3138](info): commencing operation
krb5kdc: starting...
W20260811 07:19:37.344877 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:19:37 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:19:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:19:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:19:37.467931 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45855
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:45855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:37.550900 3159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:37.551158 3159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:37.551198 3159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:37.552368 3159 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:19:37.552434 3159 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:19:37.552455 3159 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:19:37.552476 3159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:37.552510 3159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:37.552539 3159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:37.552567 3159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:37.552591 3159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:37.554085 3159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:45855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:37.554361 3159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:37.554591 3159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:19:37.559711 3159 server_base.cc:1034] running on GCE node
W20260811 07:19:37.559813 3167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:37.559732 3168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:37.560000 3173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:37.560319 3159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:37.560659 3159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:37.561836 3159 hybrid_clock.cc:648] HybridClock initialized: now 1786432777561820 us; error 45 us; skew 500 ppm
Aug 11 07:19:37 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432777, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:37.564343 3159 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:19:37.564826 3159 webserver.cc:460] Webserver started at http://127.9.142.190:35617/ using document root <none> and password file <none>
I20260811 07:19:37.565018 3159 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:37.565059 3159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:37.565150 3159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:37.566151 3159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "e3449208f7da4476b9b839036a02969b"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "6b0cf69c0b849c213a56a2298ad0de19"
server_key_iv: "5054f519f9d29c81ae4daf62c4e8e487"
server_key_version: "encryptionkey@0"
I20260811 07:19:37.566474 3159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "e3449208f7da4476b9b839036a02969b"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "6b0cf69c0b849c213a56a2298ad0de19"
server_key_iv: "5054f519f9d29c81ae4daf62c4e8e487"
server_key_version: "encryptionkey@0"
I20260811 07:19:37.567853 3159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 07:19:37.568575 3188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:37.568745 3159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:19:37.568840 3159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "e3449208f7da4476b9b839036a02969b"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "6b0cf69c0b849c213a56a2298ad0de19"
server_key_iv: "5054f519f9d29c81ae4daf62c4e8e487"
server_key_version: "encryptionkey@0"
I20260811 07:19:37.568914 3159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:37.593896 3159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:37.595695 3159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:37.595913 3159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:37.599944 3159 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:45855
I20260811 07:19:37.599992 3282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:45855 every 8 connection(s)
I20260811 07:19:37.600392 3159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:19:37.601310 3284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:37.602993 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 3159
I20260811 07:19:37.603123 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:19:37.603345 9786 external_mini_cluster.cc:1428] Setting key 4126dcb621aeb60b107c8803a0faf433
I20260811 07:19:37.604176 3284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Bootstrap starting.
I20260811 07:19:37.604858 3284 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:37.605254 3284 log.cc:824] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:37.606050 3284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: No bootstrap required, opened a new log
I20260811 07:19:37.608335 3284 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:19:37.608525 3284 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:37.608556 3284 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3449208f7da4476b9b839036a02969b, State: Initialized, Role: FOLLOWER
I20260811 07:19:37.608726 3284 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:19:37.608857 3284 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:19:37.608906 3284 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:19:37.608958 3284 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:37.609707 3284 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:19:37.609826 3284 leader_election.cc:302] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3449208f7da4476b9b839036a02969b; no voters:
I20260811 07:19:37.610037 3284 leader_election.cc:288] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:19:37.610057 3290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:37.610175 3290 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 1 LEADER]: Becoming Leader. State: Replica: e3449208f7da4476b9b839036a02969b, State: Running, Role: LEADER
I20260811 07:19:37.610355 3284 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 07:19:37 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:37.610361 3290 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:19:37.612434 3291 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3449208f7da4476b9b839036a02969b. Latest consensus state: current_term: 1 leader_uuid: "e3449208f7da4476b9b839036a02969b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } } }
I20260811 07:19:37.612442 3294 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3449208f7da4476b9b839036a02969b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } } }
I20260811 07:19:37.612690 3291 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:37.612702 3294 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: This master's current role is: LEADER
W20260811 07:19:37.612962 3312 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:19:37.613029 3312 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:19:37.613627 3315 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:19:37.613863 3315 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:19:37.614974 3287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:37.603890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54622 (local address 127.9.142.190:45855)
0811 07:19:37.604074 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:37.604082 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:37.604109 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:19:37.604573 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:37.604580 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:37.604626 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:37.604740 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:37.605608 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.606638 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.607706 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.608158 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.608237 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:37.611156 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:37.611161 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:37.611161 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:37.611173 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:37.613277 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:37.613688 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:37.613691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:37.613692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:37.613798 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:37.614022 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:37.614023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:37.614023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:37.614331 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:37.614494 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:37.614622 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 07:19:37.614765 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
I20260811 07:19:37.615713 3315 catalog_manager.cc:1347] Generated new cluster ID: 42db69fb5ff8473ca4d58cd260e428b5
I20260811 07:19:37.615792 3315 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:19:37.624436 3315 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:19:37.625046 3315 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:19:37.634346 3315 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Generated new TSK 0
I20260811 07:19:37.634547 3315 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:19:37.671728 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45855
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:37.757808 3323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:37.758011 3323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:37.758035 3323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:37.759176 3323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:37.759222 3323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:37.759248 3323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:19:37.760746 3323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:37.760991 3323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:37.761236 3323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:37.766239 3334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:37.766238 3343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:37.766278 3336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:37.766567 3323 server_base.cc:1034] running on GCE node
I20260811 07:19:37.766784 3323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:37.767059 3323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:37.768231 3323 hybrid_clock.cc:648] HybridClock initialized: now 1786432777768214 us; error 27 us; skew 500 ppm
Aug 11 07:19:37 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432777, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:37.770877 3323 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:19:37.771309 3323 webserver.cc:460] Webserver started at http://127.9.142.129:36507/ using document root <none> and password file <none>
I20260811 07:19:37.771548 3323 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:37.771616 3323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:37.771812 3323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:37.773013 3323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "4f452ba5b2694c658075cf89b2259d6a"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "db8a484ed479d47188a968a110fef782"
server_key_iv: "b258fab01a802b21330e7dcb9dbf54f0"
server_key_version: "encryptionkey@0"
I20260811 07:19:37.773422 3323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "4f452ba5b2694c658075cf89b2259d6a"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "db8a484ed479d47188a968a110fef782"
server_key_iv: "b258fab01a802b21330e7dcb9dbf54f0"
server_key_version: "encryptionkey@0"
I20260811 07:19:37.774853 3323 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:19:37.775729 3356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:37.776022 3323 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:37.776141 3323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "4f452ba5b2694c658075cf89b2259d6a"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "db8a484ed479d47188a968a110fef782"
server_key_iv: "b258fab01a802b21330e7dcb9dbf54f0"
server_key_version: "encryptionkey@0"
I20260811 07:19:37.776232 3323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:37.795200 3323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:37.797914 3323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:37.798089 3323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:37.798362 3323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:37.798707 3323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:37.798763 3323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:37.798805 3323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:37.798836 3323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:37.805004 3323 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:33045
I20260811 07:19:37.805106 3577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:33045 every 8 connection(s)
I20260811 07:19:37.805426 3323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:19:37.807427 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 3323
I20260811 07:19:37.807560 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:19:37.807857 9786 external_mini_cluster.cc:1428] Setting key f1a06264fe53fe5ba283428b3ad4dda8
Aug 11 07:19:37 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432777, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:37.818025 3287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:37.806202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:33837 (local address 127.9.142.190:45855)
0811 07:19:37.806262 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:37.806265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:37.806695 (+ 430us) server_negotiation.cc:407] Connection header received
0811 07:19:37.807885 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:37.807887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:37.807899 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:37.807987 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:37.809488 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.810007 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.811507 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.811867 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.811960 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:37.814894 (+ 2934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:37.814896 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:37.814896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:37.814904 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:37.816515 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:37.816996 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:37.816998 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:37.816998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:37.817064 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:37.817333 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:37.817334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:37.817334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:37.817460 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:37.817534 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:37.817830 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 07:19:37.817928 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 07:19:37.818244 3585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:37.806139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:33837)
0811 07:19:37.806327 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:37.806487 (+ 160us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:37.807656 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:37.808073 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:37.808078 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:37.809048 (+ 970us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:37.809364 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:37.809372 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.810114 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.810116 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:37.811391 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:37.811395 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.812010 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.812011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:37.812173 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:37.812852 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:37.812863 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:37.814788 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:37.816647 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:37.816655 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:37.816658 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:37.816898 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:37.817134 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:37.817135 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:37.817136 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:37.817257 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:37.817540 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:37.817548 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:37.817692 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 07:19:37.817796 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 07:19:37.817979 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":106,"threads_started":1}
I20260811 07:19:37.818991 3579 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45855
I20260811 07:19:37.819093 3579 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:37.819324 3579 heartbeater.cc:511] Master 127.9.142.190:45855 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
I20260811 07:19:37.820055 3217 ts_manager.cc:194] Registered new tserver with Master: 4f452ba5b2694c658075cf89b2259d6a (127.9.142.129:33045)
I20260811 07:19:37.820814 3217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:33837
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:19:37.840971 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45855
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:37.934991 3589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:37.935238 3589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:37.935274 3589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:37.936691 3589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:37.936761 3589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:37.936803 3589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:19:37.938411 3589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:37.938623 3589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:37.938827 3589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:37.944108 3595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:37.944152 3598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:37.944108 3600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:37.944703 3589 server_base.cc:1034] running on GCE node
I20260811 07:19:37.944994 3589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:37.945266 3589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:37.946460 3589 hybrid_clock.cc:648] HybridClock initialized: now 1786432777946489 us; error 100 us; skew 500 ppm
Aug 11 07:19:37 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432777, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:37.949456 3589 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:19:37.949873 3589 webserver.cc:460] Webserver started at http://127.9.142.130:44471/ using document root <none> and password file <none>
I20260811 07:19:37.950070 3589 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:37.950111 3589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:37.950205 3589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:37.951238 3589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "c0aa7dc1c64449118128d54e292dc7bc"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "d824285da53aff65dd6d70e8b4567a59"
server_key_iv: "b7d408fb90014ebdddb608239418038a"
server_key_version: "encryptionkey@0"
I20260811 07:19:37.951557 3589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "c0aa7dc1c64449118128d54e292dc7bc"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "d824285da53aff65dd6d70e8b4567a59"
server_key_iv: "b7d408fb90014ebdddb608239418038a"
server_key_version: "encryptionkey@0"
I20260811 07:19:37.952983 3589 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:19:37.953753 3610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:37.953966 3589 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:37.954069 3589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "c0aa7dc1c64449118128d54e292dc7bc"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "d824285da53aff65dd6d70e8b4567a59"
server_key_iv: "b7d408fb90014ebdddb608239418038a"
server_key_version: "encryptionkey@0"
I20260811 07:19:37.954134 3589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:37.963145 3589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:37.966223 3589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:37.966361 3589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:37.966586 3589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:37.966997 3589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:37.967070 3589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:37.967108 3589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:37.967142 3589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:37.973809 3589 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:46157
I20260811 07:19:37.973894 3818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:46157 every 8 connection(s)
I20260811 07:19:37.974270 3589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:19:37.977567 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 3589
I20260811 07:19:37.977759 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:19:37.978164 9786 external_mini_cluster.cc:1428] Setting key f20e02778f10d54ff7475ac29e7c5073
Aug 11 07:19:37 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432777, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:37.987725 3824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:37.975134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:34805)
0811 07:19:37.975470 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:37.975546 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:37.976331 (+ 785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:37.976834 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:37.976840 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:37.977582 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:37.977888 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:37.977909 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.978962 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.978964 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:37.979986 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:37.979990 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.980543 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.980545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:37.980672 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:37.981437 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:37.981450 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:37.983245 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:37.985899 (+ 2654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:37.985907 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:37.985909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:37.986146 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:37.986394 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:37.986394 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:37.986395 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:37.986508 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:37.987061 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:37.987069 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:37.987227 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 07:19:37.987345 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 07:19:37.987528 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":105,"threads_started":1}
I20260811 07:19:37.987833 3287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:37.975322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:34805 (local address 127.9.142.190:45855)
0811 07:19:37.975444 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:37.975447 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:37.975690 (+ 243us) server_negotiation.cc:407] Connection header received
0811 07:19:37.976509 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:37.976564 (+ 55us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:37.976599 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:37.976691 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:37.978033 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.978825 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.980087 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:37.980430 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:37.980507 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:37.983353 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:37.983355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:37.983355 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:37.983364 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:37.985789 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:37.986232 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:37.986234 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:37.986234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:37.986310 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:37.986623 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:37.986625 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:37.986625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:37.986934 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:37.987102 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:37.987415 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 07:19:37.987558 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:19:37.988415 3822 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45855
I20260811 07:19:37.988549 3822 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:37.988794 3822 heartbeater.cc:511] Master 127.9.142.190:45855 requested a full tablet report, sending...
I20260811 07:19:37.989392 3217 ts_manager.cc:194] Registered new tserver with Master: c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157)
I20260811 07:19:37.989835 3217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:34805
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:19:38.011575 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45855
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:38.096648 3829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:38.096869 3829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:38.096894 3829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:38.098047 3829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:38.098093 3829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:38.098119 3829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:19:38.099572 3829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:45855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:38.099841 3829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:38.100091 3829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:38.105342 3840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:38.105332 3836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:38.105332 3844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:38.105572 3829 server_base.cc:1034] running on GCE node
I20260811 07:19:38.105882 3829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:38.106195 3829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:38.107388 3829 hybrid_clock.cc:648] HybridClock initialized: now 1786432778107372 us; error 42 us; skew 500 ppm
Aug 11 07:19:38 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432778, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:38.110275 3829 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:19:38.110780 3829 webserver.cc:460] Webserver started at http://127.9.142.131:42329/ using document root <none> and password file <none>
I20260811 07:19:38.111061 3829 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:38.111109 3829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:38.111277 3829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:19:38.112444 3829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "cd1e31462ee545059b92e9fdd28c75e9"
format_stamp: "Formatted at 2026-08-11 07:19:38 on dist-test-slave-7f01"
server_key: "b91131a24cc244db9b10cc6523644c96"
server_key_iv: "9cacef1638e8941a54da392849496c02"
server_key_version: "encryptionkey@0"
I20260811 07:19:38.112813 3829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "cd1e31462ee545059b92e9fdd28c75e9"
format_stamp: "Formatted at 2026-08-11 07:19:38 on dist-test-slave-7f01"
server_key: "b91131a24cc244db9b10cc6523644c96"
server_key_iv: "9cacef1638e8941a54da392849496c02"
server_key_version: "encryptionkey@0"
I20260811 07:19:38.114228 3829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:19:38.115159 3853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:38.115355 3829 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:38.115450 3829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "cd1e31462ee545059b92e9fdd28c75e9"
format_stamp: "Formatted at 2026-08-11 07:19:38 on dist-test-slave-7f01"
server_key: "b91131a24cc244db9b10cc6523644c96"
server_key_iv: "9cacef1638e8941a54da392849496c02"
server_key_version: "encryptionkey@0"
I20260811 07:19:38.115507 3829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:38.126116 3829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:38.128374 3829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:38.128490 3829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:38.128688 3829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:38.129032 3829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:38.129069 3829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:38.129092 3829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:38.129141 3829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:38.135643 3829 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:43405
I20260811 07:19:38.135691 4065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:43405 every 8 connection(s)
I20260811 07:19:38.136071 3829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:19:38.137241 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 3829
I20260811 07:19:38.137372 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:19:38.137605 9786 external_mini_cluster.cc:1428] Setting key 933b1b8866e86ef1b13ae64f094e66bc
Aug 11 07:19:38 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432778, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:38.146967 3287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.136828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:48327 (local address 127.9.142.190:45855)
0811 07:19:38.136878 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:38.136880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:38.137233 (+ 353us) server_negotiation.cc:407] Connection header received
0811 07:19:38.138020 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:38.138021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:38.138035 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:38.138094 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:38.139337 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.140030 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.141140 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.141325 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.141592 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.143990 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:38.143992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:38.143992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:38.144000 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:38.145334 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:38.145968 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:38.145969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:38.145969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:38.146026 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:38.146293 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:38.146294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:38.146294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:38.146423 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:38.146487 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:38.146789 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 07:19:38.146899 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:19:38.147110 4074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.136833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:48327)
0811 07:19:38.137013 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:38.137106 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:38.137897 (+ 791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:38.138186 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:38.138191 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:38.139025 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:38.139246 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.139252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.140125 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.140126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.141048 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.141051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.141611 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.141613 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.141737 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.142334 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:38.142343 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:38.143886 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:38.145498 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:38.145517 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:38.145521 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:38.145868 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:38.146102 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:38.146103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:38.146103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:38.146210 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:38.146494 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:38.146501 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:38.146625 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 07:19:38.146722 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 07:19:38.146867 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
I20260811 07:19:38.147666 4066 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45855
I20260811 07:19:38.147835 4066 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:38.148039 4066 heartbeater.cc:511] Master 127.9.142.190:45855 requested a full tablet report, sending...
I20260811 07:19:38.148445 3217 ts_manager.cc:194] Registered new tserver with Master: cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405)
I20260811 07:19:38.148811 3217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:48327
I20260811 07:19:38.149643 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:19:38.157788 3287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.151105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54628 (local address 127.9.142.190:45855)
0811 07:19:38.151157 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:38.151159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:38.151316 (+ 157us) server_negotiation.cc:407] Connection header received
0811 07:19:38.151374 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:38.151375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:38.151383 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:38.151433 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:38.152178 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.152708 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.153538 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.153715 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.153770 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.155094 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:38.155095 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:38.155095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:38.155100 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:38.156520 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:38.156883 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:38.156884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:38.156884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:38.156936 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:38.157122 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:38.157123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:38.157123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:38.157285 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:38.157404 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:38.157600 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 07:19:38.157680 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 07:19:38.159606 3217 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:19:38.161298 3217 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:19:38.168180 4091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.163881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:43405 (local address 127.0.0.1:55030)
0811 07:19:38.164274 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:38.164284 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:38.164335 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:38.164663 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:38.164664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:38.164667 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:38.164711 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.164713 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.166043 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.166044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.167052 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.167055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.167933 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.167934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.167981 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.167985 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:38.168016 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 07:19:38.168071 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":16,"thread_start_us":77,"threads_started":1}
I20260811 07:19:38.168180 4094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.163645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33045 (local address 127.0.0.1:37804)
0811 07:19:38.164049 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:38.164061 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:38.164124 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:38.164433 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:38.164434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:38.164436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:38.164470 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.164471 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.165416 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.165417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.166796 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.166800 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.167841 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.167842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.167950 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.167967 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 07:19:38.168041 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 07:19:38.168072 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":83,"threads_started":1}
I20260811 07:19:38.168635 4092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.163642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:46157 (local address 127.0.0.1:34162)
0811 07:19:38.163850 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:38.163893 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:38.163977 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:38.164237 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:38.164240 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:38.164242 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:38.164316 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.164318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.165973 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.165975 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.167257 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.167260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.168406 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.168407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.168470 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.168473 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:19:38.168534 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 07:19:38.168577 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":82,"threads_started":1}
I20260811 07:19:38.168675 4093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.163775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34162 (local address 127.9.142.130:46157)
0811 07:19:38.163987 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:38.163992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:38.164004 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:19:38.164102 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:38.164104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:38.164123 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:38.164209 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:38.164596 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.165862 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.167352 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.168304 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.168405 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.168465 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:38.168547 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 07:19:38.168589 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":95,"threads_started":1}
I20260811 07:19:38.168692 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.164099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55030 (local address 127.9.142.131:43405)
0811 07:19:38.164493 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:38.164498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:38.164507 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:19:38.164546 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:38.164549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:38.164564 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:38.164790 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:38.164867 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.165920 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.167186 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.167834 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.168463 (+ 629us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.168536 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:38.168560 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 07:19:38.168604 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":97,"threads_started":1}
I20260811 07:19:38.169467 4095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.163843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37804 (local address 127.9.142.129:33045)
0811 07:19:38.164258 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:38.164263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:38.164273 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:19:38.164310 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:38.164312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:38.164328 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:38.164436 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:38.164528 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.165299 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.166893 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.167731 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.167838 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.167898 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:38.168072 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 07:19:38.168115 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":114,"threads_started":1}
I20260811 07:19:38.169409 3694 tablet_service.cc:1467] Processing CreateTablet for tablet 0b16dd6c85374ee4b9994435976ff03e (DEFAULT_TABLE table=test-table [id=fbc3cf64abb0413b909222c0e08519f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:38.169471 3940 tablet_service.cc:1467] Processing CreateTablet for tablet 0b16dd6c85374ee4b9994435976ff03e (DEFAULT_TABLE table=test-table [id=fbc3cf64abb0413b909222c0e08519f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:38.169853 3940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b16dd6c85374ee4b9994435976ff03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:38.169844 3694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b16dd6c85374ee4b9994435976ff03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:38.170274 3459 tablet_service.cc:1467] Processing CreateTablet for tablet 0b16dd6c85374ee4b9994435976ff03e (DEFAULT_TABLE table=test-table [id=fbc3cf64abb0413b909222c0e08519f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:38.170737 3459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b16dd6c85374ee4b9994435976ff03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:38.173008 4097 tablet_bootstrap.cc:492] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: Bootstrap starting.
I20260811 07:19:38.173581 4098 tablet_bootstrap.cc:492] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: Bootstrap starting.
I20260811 07:19:38.173900 4097 tablet_bootstrap.cc:654] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:38.174310 4098 tablet_bootstrap.cc:654] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:38.174834 4097 log.cc:824] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:38.174899 4098 log.cc:824] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:38.175209 4099 tablet_bootstrap.cc:492] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Bootstrap starting.
I20260811 07:19:38.175688 4098 tablet_bootstrap.cc:492] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: No bootstrap required, opened a new log
I20260811 07:19:38.175694 4097 tablet_bootstrap.cc:492] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: No bootstrap required, opened a new log
I20260811 07:19:38.175794 4097 ts_tablet_manager.cc:1397] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:19:38.175800 4098 ts_tablet_manager.cc:1397] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:38.177855 4098 raft_consensus.cc:348] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:38.177855 4097 raft_consensus.cc:348] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:38.178054 4098 raft_consensus.cc:374] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:38.178107 4098 raft_consensus.cc:729] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0aa7dc1c64449118128d54e292dc7bc, State: Initialized, Role: FOLLOWER
I20260811 07:19:38.178054 4097 raft_consensus.cc:374] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:38.178185 4097 raft_consensus.cc:729] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd1e31462ee545059b92e9fdd28c75e9, State: Initialized, Role: FOLLOWER
I20260811 07:19:38.178260 4098 consensus_queue.cc:260] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:38.178311 4097 consensus_queue.cc:260] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:38.178608 4098 ts_tablet_manager.cc:1428] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:19:38.178608 4097 ts_tablet_manager.cc:1428] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:19:38.178684 4066 heartbeater.cc:503] Master 127.9.142.190:45855 was elected leader, sending a full tablet report...
I20260811 07:19:38.178711 3822 heartbeater.cc:503] Master 127.9.142.190:45855 was elected leader, sending a full tablet report...
I20260811 07:19:38.179340 4099 tablet_bootstrap.cc:654] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:38.180047 4099 log.cc:824] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:38.180845 4099 tablet_bootstrap.cc:492] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: No bootstrap required, opened a new log
I20260811 07:19:38.180910 4099 ts_tablet_manager.cc:1397] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260811 07:19:38.182503 4099 raft_consensus.cc:348] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:38.182703 4099 raft_consensus.cc:374] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:38.182731 4099 raft_consensus.cc:729] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f452ba5b2694c658075cf89b2259d6a, State: Initialized, Role: FOLLOWER
I20260811 07:19:38.182879 4099 consensus_queue.cc:260] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:38.183178 4099 ts_tablet_manager.cc:1428] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 07:19:38.183219 3579 heartbeater.cc:503] Master 127.9.142.190:45855 was elected leader, sending a full tablet report...
W20260811 07:19:38.224993 3823 tablet.cc:2369] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:19:38.238843 4108 raft_consensus.cc:482] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:38.238966 4108 raft_consensus.cc:504] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:38.239305 4108 leader_election.cc:288] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157), cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405)
I20260811 07:19:38.242442 3585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.239476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:43405 (local address 127.9.142.129:41587)
0811 07:19:38.239575 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:38.239588 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:38.239637 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:38.239861 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:38.239862 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:38.239865 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:38.239953 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.239956 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.240732 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.240733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.241553 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.241555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.242180 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.242181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.242281 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.242286 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:19:38.242342 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:19:38.242385 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 07:19:38.242491 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.239663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:41587 (local address 127.9.142.131:43405)
0811 07:19:38.239708 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:38.239711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:38.239718 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:19:38.239768 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:38.239769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:38.239780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:38.239836 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:38.240027 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.240644 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.241643 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.242091 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.242148 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.242156 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:38.242358 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 07:19:38.242401 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:19:38.242604 4093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.239565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:56935 (local address 127.9.142.130:46157)
0811 07:19:38.239614 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:38.239617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:38.240021 (+ 404us) server_negotiation.cc:407] Connection header received
0811 07:19:38.240046 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:38.240047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:38.240067 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:38.240105 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:38.240312 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.240827 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.241789 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.242222 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.242295 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.242304 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:38.242505 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 07:19:38.242551 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:19:38.242616 4109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.239476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:46157 (local address 127.9.142.129:56935)
0811 07:19:38.239764 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:38.239773 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:38.239826 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:38.240140 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:38.240141 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:38.240143 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:38.240229 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.240230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.240912 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.240913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.241694 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:38.241696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.242313 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.242314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:38.242410 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.242414 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:38.242483 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:19:38.242523 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":55,"thread_start_us":122,"threads_started":1}
I20260811 07:19:38.243000 3744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b16dd6c85374ee4b9994435976ff03e" candidate_uuid: "4f452ba5b2694c658075cf89b2259d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0aa7dc1c64449118128d54e292dc7bc" is_pre_election: true
I20260811 07:19:38.243044 3980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b16dd6c85374ee4b9994435976ff03e" candidate_uuid: "4f452ba5b2694c658075cf89b2259d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd1e31462ee545059b92e9fdd28c75e9" is_pre_election: true
I20260811 07:19:38.243170 3744 raft_consensus.cc:2454] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f452ba5b2694c658075cf89b2259d6a in term 0.
I20260811 07:19:38.243197 3980 raft_consensus.cc:2454] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f452ba5b2694c658075cf89b2259d6a in term 0.
I20260811 07:19:38.243434 3371 leader_election.cc:302] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f452ba5b2694c658075cf89b2259d6a, c0aa7dc1c64449118128d54e292dc7bc; no voters:
I20260811 07:19:38.243604 4108 raft_consensus.cc:2781] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:19:38.243688 4108 raft_consensus.cc:482] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:19:38.243726 4108 raft_consensus.cc:3037] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:38.244490 4108 raft_consensus.cc:504] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:38.244644 4108 leader_election.cc:288] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 1 election: Requested vote from peers c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157), cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405)
I20260811 07:19:38.244793 3744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b16dd6c85374ee4b9994435976ff03e" candidate_uuid: "4f452ba5b2694c658075cf89b2259d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0aa7dc1c64449118128d54e292dc7bc"
I20260811 07:19:38.244872 3744 raft_consensus.cc:3037] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:38.244827 3980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b16dd6c85374ee4b9994435976ff03e" candidate_uuid: "4f452ba5b2694c658075cf89b2259d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd1e31462ee545059b92e9fdd28c75e9"
I20260811 07:19:38.244941 3980 raft_consensus.cc:3037] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:38.245544 3744 raft_consensus.cc:2454] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f452ba5b2694c658075cf89b2259d6a in term 1.
I20260811 07:19:38.245707 3371 leader_election.cc:302] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f452ba5b2694c658075cf89b2259d6a, c0aa7dc1c64449118128d54e292dc7bc; no voters:
I20260811 07:19:38.245786 3980 raft_consensus.cc:2454] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f452ba5b2694c658075cf89b2259d6a in term 1.
I20260811 07:19:38.245810 4108 raft_consensus.cc:2781] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:38.246003 4108 raft_consensus.cc:686] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 1 LEADER]: Becoming Leader. State: Replica: 4f452ba5b2694c658075cf89b2259d6a, State: Running, Role: LEADER
I20260811 07:19:38.246129 4108 consensus_queue.cc:237] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:38.246989 3217 catalog_manager.cc:5495] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f452ba5b2694c658075cf89b2259d6a (127.9.142.129). New cstate: current_term: 1 leader_uuid: "4f452ba5b2694c658075cf89b2259d6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } health_report { overall_health: UNKNOWN } } }
I20260811 07:19:38.262261 4095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.260159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37806 (local address 127.9.142.129:33045)
0811 07:19:38.260208 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:38.260210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:38.260232 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:19:38.260307 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:38.260307 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:38.260323 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:38.260384 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:19:38.260521 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.260937 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.261634 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:38.261807 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:38.261855 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:38.262002 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:19:38.262089 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:19:38.262149 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:38.262183 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 07:19:38.262200 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:19:38.263942 3980 raft_consensus.cc:1261] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [term 1 FOLLOWER]: Refusing update from remote peer 4f452ba5b2694c658075cf89b2259d6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:38.263965 3744 raft_consensus.cc:1261] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [term 1 FOLLOWER]: Refusing update from remote peer 4f452ba5b2694c658075cf89b2259d6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:38.264253 4108 consensus_queue.cc:1035] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:38.264380 4111 consensus_queue.cc:1035] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:38.266515 4115 mvcc.cc:205] Tried to move back new op lower bound from 7317228659766480896 to 7317228659696631808. Current Snapshot: MvccSnapshot[applied={T|T < 7317228659766480896}]
I20260811 07:19:38.266801 4117 mvcc.cc:205] Tried to move back new op lower bound from 7317228659766480896 to 7317228659696631808. Current Snapshot: MvccSnapshot[applied={T|T < 7317228659766480896}]
I20260811 07:19:38.266930 4116 mvcc.cc:205] Tried to move back new op lower bound from 7317228659766480896 to 7317228659696631808. Current Snapshot: MvccSnapshot[applied={T|T < 7317228659766480896}]
I20260811 07:19:38.269203 3216 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:38.269315 3216 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:38.270117 3216 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Sending DeleteTablet for 3 replicas of tablet 0b16dd6c85374ee4b9994435976ff03e
I20260811 07:19:38.270479 3459 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b16dd6c85374ee4b9994435976ff03e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:38 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:37804
I20260811 07:19:38.270530 3694 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b16dd6c85374ee4b9994435976ff03e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:38 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:34162
I20260811 07:19:38.270556 3940 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b16dd6c85374ee4b9994435976ff03e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:38 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:55030
I20260811 07:19:38.270782 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 3323
I20260811 07:19:38.283957 4130 tablet_replica.cc:330] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: stopping tablet replica
I20260811 07:19:38.284147 4130 raft_consensus.cc:2229] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:38.284261 4133 tablet_replica.cc:330] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: stopping tablet replica
I20260811 07:19:38.284307 4130 raft_consensus.cc:2258] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:38.284426 4133 raft_consensus.cc:2229] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:38.284565 4133 raft_consensus.cc:2258] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:38.284854 4130 ts_tablet_manager.cc:1905] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:38.285053 4133 ts_tablet_manager.cc:1905] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:38.286811 4133 ts_tablet_manager.cc:1918] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:38.286938 4133 log.cc:1196] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/0b16dd6c85374ee4b9994435976ff03e
I20260811 07:19:38.287047 4130 ts_tablet_manager.cc:1918] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:38.287132 4130 log.cc:1196] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/0b16dd6c85374ee4b9994435976ff03e
I20260811 07:19:38.287261 4133 ts_tablet_manager.cc:1939] T 0b16dd6c85374ee4b9994435976ff03e P cd1e31462ee545059b92e9fdd28c75e9: Deleting consensus metadata
I20260811 07:19:38.287417 4130 ts_tablet_manager.cc:1939] T 0b16dd6c85374ee4b9994435976ff03e P c0aa7dc1c64449118128d54e292dc7bc: Deleting consensus metadata
I20260811 07:19:38.287874 3192 catalog_manager.cc:4841] TS cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405): tablet 0b16dd6c85374ee4b9994435976ff03e (table test-table [id=fbc3cf64abb0413b909222c0e08519f4]) successfully deleted
I20260811 07:19:38.287881 3194 catalog_manager.cc:4841] TS c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157): tablet 0b16dd6c85374ee4b9994435976ff03e (table test-table [id=fbc3cf64abb0413b909222c0e08519f4]) successfully deleted
W20260811 07:19:38.288949 3192 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:33045 (error 108)
I20260811 07:19:38.289078 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 3589
I20260811 07:19:38.293433 4092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:38.293271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33045 (local address 127.0.0.1:37822)
0811 07:19:38.293338 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:38.293388 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 07:19:38.293593 3192 catalog_manager.cc:4584] TS 4f452ba5b2694c658075cf89b2259d6a (127.9.142.129:33045): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0b16dd6c85374ee4b9994435976ff03e: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33045: connect: Connection refused (error 111)
I20260811 07:19:38.312759 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 3829
I20260811 07:19:38.322113 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 3159
I20260811 07:19:58.334820 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45855
--webserver_interface=127.9.142.190
--webserver_port=35617
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:45855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:19:58.419418 4137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:58.419616 4137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:58.419639 4137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:58.420782 4137 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:19:58.420823 4137 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:19:58.420837 4137 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:19:58.420848 4137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:19:58.420861 4137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:58.420874 4137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:58.420886 4137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:19:58.420948 4137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:19:58.422394 4137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:45855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=35617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:58.422643 4137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:58.422894 4137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:58.432855 4149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:58.432873 4137 server_base.cc:1034] running on GCE node
W20260811 07:19:58.432933 4147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:58.432974 4145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:58.433364 4137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:58.433719 4137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:58.434883 4137 hybrid_clock.cc:648] HybridClock initialized: now 1786432798434865 us; error 51 us; skew 500 ppm
Aug 11 07:19:58 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432798, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:58.437443 4137 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:19:58.437918 4137 webserver.cc:460] Webserver started at http://127.9.142.190:35617/ using document root <none> and password file <none>
I20260811 07:19:58.438185 4137 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:58.438280 4137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:58.439713 4137 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:19:58.440444 4164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:58.440623 4137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:19:58.440740 4137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "e3449208f7da4476b9b839036a02969b"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "6b0cf69c0b849c213a56a2298ad0de19"
server_key_iv: "5054f519f9d29c81ae4daf62c4e8e487"
server_key_version: "encryptionkey@0"
I20260811 07:19:58.441170 4137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:58.463652 4137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:58.465718 4137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:58.465922 4137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:58.470304 4137 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:45855
I20260811 07:19:58.470361 4246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:45855 every 8 connection(s)
I20260811 07:19:58.470796 4137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:19:58.471403 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 4137
I20260811 07:19:58.471786 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:33045
--local_ip_for_outbound_sockets=127.9.142.129
--tserver_master_addrs=127.9.142.190:45855
--webserver_port=36507
--webserver_interface=127.9.142.129
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:19:58.473174 4247 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:19:58.474287 4247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Bootstrap starting.
I20260811 07:19:58.484127 4247 log.cc:824] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:58.486143 4247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:19:58.486465 4247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Bootstrap complete.
I20260811 07:19:58.488977 4247 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:19:58.489238 4247 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3449208f7da4476b9b839036a02969b, State: Initialized, Role: FOLLOWER
I20260811 07:19:58.489454 4247 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:19:58.489557 4247 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:19:58.489619 4247 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:19:58.489668 4247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:19:58.490703 4247 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:19:58.490842 4247 leader_election.cc:302] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3449208f7da4476b9b839036a02969b; no voters:
I20260811 07:19:58.491055 4247 leader_election.cc:288] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:19:58.491091 4253 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:19:58.491211 4253 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 2 LEADER]: Becoming Leader. State: Replica: e3449208f7da4476b9b839036a02969b, State: Running, Role: LEADER
I20260811 07:19:58.491324 4253 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:19:58.491387 4247 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:19:58.491629 4253 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3449208f7da4476b9b839036a02969b. Latest consensus state: current_term: 2 leader_uuid: "e3449208f7da4476b9b839036a02969b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } } }
I20260811 07:19:58.491709 4253 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:58.491637 4254 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e3449208f7da4476b9b839036a02969b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } } }
I20260811 07:19:58.491930 4254 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: This master's current role is: LEADER
I20260811 07:19:58.493213 4281 catalog_manager.cc:1259] Loaded cluster ID: 42db69fb5ff8473ca4d58cd260e428b5
I20260811 07:19:58.493290 4281 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: loading cluster ID for follower catalog manager: success
I20260811 07:19:58.494226 4281 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: acquiring CA information for follower catalog manager: success
I20260811 07:19:58.494611 4281 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:19:58.494704 4260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:19:58.495050 4260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:19:58.495151 4260 catalog_manager.cc:1259] Loaded cluster ID: 42db69fb5ff8473ca4d58cd260e428b5
I20260811 07:19:58.495208 4260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:19:58.495388 4260 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:19:58.495491 4260 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Loaded TSK: 0
I20260811 07:19:58.501379 4260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Generated new TSK 1
I20260811 07:19:58.501487 4260 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:19:58.567713 4251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:58.568042 4251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:58.568073 4251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:58.569386 4251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:58.569435 4251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:58.569466 4251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:19:58.571254 4251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:33045
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=36507
--tserver_master_addrs=127.9.142.190:45855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:58.571529 4251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:58.571842 4251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:58.577018 4292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:58.577018 4298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:58.577033 4293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:58.577525 4251 server_base.cc:1034] running on GCE node
I20260811 07:19:58.577733 4251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:58.578008 4251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:58.579180 4251 hybrid_clock.cc:648] HybridClock initialized: now 1786432798579167 us; error 33 us; skew 500 ppm
Aug 11 07:19:58 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432798, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:58.582069 4251 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:19:58.582625 4251 webserver.cc:460] Webserver started at http://127.9.142.129:36507/ using document root <none> and password file <none>
I20260811 07:19:58.582899 4251 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:58.582988 4251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:58.584856 4251 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:58.585678 4310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:58.585906 4251 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:58.586014 4251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "4f452ba5b2694c658075cf89b2259d6a"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "db8a484ed479d47188a968a110fef782"
server_key_iv: "b258fab01a802b21330e7dcb9dbf54f0"
server_key_version: "encryptionkey@0"
I20260811 07:19:58.586491 4251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:58.614081 4251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:58.616915 4251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:58.617090 4251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:58.617400 4251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:58.618000 4320 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:19:58.619634 4251 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:19:58.619701 4251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 07:19:58.619762 4251 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:19:58.620667 4251 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:19:58.620718 4251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 07:19:58.620867 4320 tablet_bootstrap.cc:492] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Bootstrap starting.
I20260811 07:19:58.627876 4251 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:33045
I20260811 07:19:58.628178 4517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:33045 every 8 connection(s)
I20260811 07:19:58.628338 4251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:19:58.628705 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 4251
I20260811 07:19:58.629113 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:46157
--local_ip_for_outbound_sockets=127.9.142.130
--tserver_master_addrs=127.9.142.190:45855
--webserver_port=44471
--webserver_interface=127.9.142.130
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:19:58.634392 4320 log.cc:824] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:58.637559 4320 tablet_bootstrap.cc:492] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:19:58.637921 4320 tablet_bootstrap.cc:492] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Bootstrap complete.
I20260811 07:19:58.639492 4320 ts_tablet_manager.cc:1397] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.014s
Aug 11 07:19:58 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432798, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:58.641803 4320 raft_consensus.cc:348] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:58.642225 4320 raft_consensus.cc:729] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f452ba5b2694c658075cf89b2259d6a, State: Initialized, Role: FOLLOWER
I20260811 07:19:58.642441 4320 consensus_queue.cc:260] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } } peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } }
I20260811 07:19:58.642767 4320 ts_tablet_manager.cc:1428] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
I20260811 07:19:58.646847 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.632596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:35837)
0811 07:19:58.633218 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:58.633283 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:58.634055 (+ 772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:58.634832 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:58.634836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:58.635285 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:58.635626 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.635634 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.637265 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.637266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.638794 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.638797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.639788 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.639789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.639927 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.640596 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:58.640607 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:58.642633 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:58.644951 (+ 2318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:58.644957 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:58.644959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:58.645250 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:58.645575 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:58.645576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:58.645577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:58.645708 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:58.646164 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:58.646172 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:58.646334 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 07:19:58.646451 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 07:19:58.646626 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":120,"threads_started":1}
I20260811 07:19:58.646880 4524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.632667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:35837 (local address 127.9.142.190:45855)
0811 07:19:58.633343 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:58.633353 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:58.633403 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:19:58.634326 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:58.634334 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:58.634401 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:58.634669 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:58.635790 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.637123 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.638892 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.639480 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.639648 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.642765 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:58.642768 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:58.642769 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:58.642781 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:58.644860 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.645366 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.645370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.645370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.645495 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.645783 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.645784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.645784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.646078 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:58.646165 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:58.646521 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:19:58.646673 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":110,"threads_started":1}
I20260811 07:19:58.647815 4520 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45855
I20260811 07:19:58.647940 4520 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:58.648119 4520 heartbeater.cc:511] Master 127.9.142.190:45855 requested a full tablet report, sending...
I20260811 07:19:58.648885 4187 ts_manager.cc:194] Registered new tserver with Master: 4f452ba5b2694c658075cf89b2259d6a (127.9.142.129:33045)
I20260811 07:19:58.650388 4187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:35837
I20260811 07:19:58.651314 4520 heartbeater.cc:503] Master 127.9.142.190:45855 was elected leader, sending a full tablet report...
Aug 11 07:19:58 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432798, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.129@KRBTEST.COM
I20260811 07:19:58.660528 4527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.650174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33045 (local address 127.0.0.1:38328)
0811 07:19:58.650361 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:58.650398 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:58.650467 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:58.651606 (+ 1139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:58.651612 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:58.652135 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:58.652198 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.652201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.653535 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.653536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.654491 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.654495 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.655230 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.655231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.655287 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.655795 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:58.655800 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:58.657300 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:58.659290 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:58.659297 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:58.659299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:58.659497 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:58.659727 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:58.659728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:58.659728 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:58.659853 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:58.660179 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:58.660186 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:58.660234 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 07:19:58.660308 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 07:19:58.660417 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":102,"threads_started":1}
I20260811 07:19:58.660574 4528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.650447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38328 (local address 127.9.142.129:33045)
0811 07:19:58.650600 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:58.650605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:58.650613 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:19:58.650727 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:58.650729 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:58.650754 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:58.652280 (+ 1526us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:58.652359 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.653435 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.654596 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.655142 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.655224 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.657395 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:58.657404 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:58.657404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:58.657412 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:58.659190 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.659581 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.659584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.659584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.659655 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.659922 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.659923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.659923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.660084 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:58.660172 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:58.660385 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 07:19:58.660471 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260811 07:19:58.661020 4396 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b16dd6c85374ee4b9994435976ff03e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:38 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:38328
I20260811 07:19:58.661617 4532 tablet_replica.cc:330] stopping tablet replica
I20260811 07:19:58.661741 4532 raft_consensus.cc:2229] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:58.661835 4532 raft_consensus.cc:2258] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:58.662154 4532 ts_tablet_manager.cc:1905] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:58.663993 4532 ts_tablet_manager.cc:1918] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:58.664084 4532 log.cc:1196] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal/wals/0b16dd6c85374ee4b9994435976ff03e
I20260811 07:19:58.664309 4532 ts_tablet_manager.cc:1939] T 0b16dd6c85374ee4b9994435976ff03e P 4f452ba5b2694c658075cf89b2259d6a: Deleting consensus metadata
I20260811 07:19:58.664817 4168 catalog_manager.cc:4841] TS 4f452ba5b2694c658075cf89b2259d6a (127.9.142.129:33045): tablet 0b16dd6c85374ee4b9994435976ff03e (table test-table [id=fbc3cf64abb0413b909222c0e08519f4]) successfully deleted
W20260811 07:19:58.727348 4522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:58.727587 4522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:58.727612 4522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:58.728852 4522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:58.728899 4522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:58.728925 4522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:19:58.730441 4522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:46157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=44471
--tserver_master_addrs=127.9.142.190:45855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:58.730710 4522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:58.730952 4522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:58.736444 4542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:58.736451 4543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:58.736601 4545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:58.736943 4522 server_base.cc:1034] running on GCE node
I20260811 07:19:58.737308 4522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:58.737599 4522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:58.738794 4522 hybrid_clock.cc:648] HybridClock initialized: now 1786432798738752 us; error 59 us; skew 500 ppm
Aug 11 07:19:58 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432798, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:58.741690 4522 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:19:58.742228 4522 webserver.cc:460] Webserver started at http://127.9.142.130:44471/ using document root <none> and password file <none>
I20260811 07:19:58.742487 4522 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:58.742583 4522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:58.744171 4522 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:58.744911 4554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:58.745152 4522 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:58.745270 4522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "c0aa7dc1c64449118128d54e292dc7bc"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "d824285da53aff65dd6d70e8b4567a59"
server_key_iv: "b7d408fb90014ebdddb608239418038a"
server_key_version: "encryptionkey@0"
I20260811 07:19:58.745643 4522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:58.776458 4522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:58.778960 4522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:58.779156 4522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:58.779433 4522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:58.779824 4522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:58.779881 4522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:58.779923 4522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:58.779964 4522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:58.786845 4522 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:46157
I20260811 07:19:58.786893 4743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:46157 every 8 connection(s)
I20260811 07:19:58.787271 4522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:19:58.789043 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 4522
I20260811 07:19:58.789354 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:43405
--local_ip_for_outbound_sockets=127.9.142.131
--tserver_master_addrs=127.9.142.190:45855
--webserver_port=42329
--webserver_interface=127.9.142.131
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:19:58 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432798, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:58.800011 4524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.788159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:42583 (local address 127.9.142.190:45855)
0811 07:19:58.788232 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:58.788234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:58.788479 (+ 245us) server_negotiation.cc:407] Connection header received
0811 07:19:58.789031 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:58.789033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:58.789053 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:58.789157 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:58.790591 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.791435 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.793029 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.793403 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.793494 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.796230 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:58.796232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:58.796232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:58.796241 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:58.798177 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.798786 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.798788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.798788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.798863 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.799164 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.799165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.799165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.799309 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:58.799399 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:58.799732 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 07:19:58.799905 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 07:19:58.800223 4747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.788165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:42583)
0811 07:19:58.788344 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:58.788384 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:58.788911 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:58.789239 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:58.789248 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:58.790180 (+ 932us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:58.790482 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.790489 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.791539 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.791541 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.792904 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.792908 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.793520 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.793522 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.793670 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.794421 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:58.794430 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:58.796107 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:58.798398 (+ 2291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:58.798408 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:58.798411 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:58.798684 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:58.798943 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:58.798944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:58.798945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:58.799078 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:58.799389 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:58.799398 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:58.799567 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 07:19:58.799692 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 07:19:58.799931 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
I20260811 07:19:58.800736 4744 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45855
I20260811 07:19:58.800860 4744 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:58.801106 4744 heartbeater.cc:511] Master 127.9.142.190:45855 requested a full tablet report, sending...
I20260811 07:19:58.801555 4187 ts_manager.cc:194] Registered new tserver with Master: c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157)
I20260811 07:19:58.801998 4187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:42583
W20260811 07:19:58.885591 4748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:19:58.885887 4748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:19:58.885936 4748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:19:58.887374 4748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:19:58.887455 4748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:19:58.887507 4748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:19:58.890008 4748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:43405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=42329
--tserver_master_addrs=127.9.142.190:45855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:19:58.890910 4748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:19:58.891242 4748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:19:58.898238 4758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:58.898231 4763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:19:58.898231 4759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:19:58.898497 4748 server_base.cc:1034] running on GCE node
I20260811 07:19:58.898725 4748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:19:58.898952 4748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:19:58.900123 4748 hybrid_clock.cc:648] HybridClock initialized: now 1786432798900113 us; error 43 us; skew 500 ppm
Aug 11 07:19:58 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432798, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:19:58.906087 4748 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:19:58.906881 4748 webserver.cc:460] Webserver started at http://127.9.142.131:42329/ using document root <none> and password file <none>
I20260811 07:19:58.907392 4748 fs_manager.cc:359] Metadata directory not provided
I20260811 07:19:58.907532 4748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:19:58.909433 4748 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:19:58.910238 4772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:58.910646 4748 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:19:58.910861 4748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "cd1e31462ee545059b92e9fdd28c75e9"
format_stamp: "Formatted at 2026-08-11 07:19:38 on dist-test-slave-7f01"
server_key: "b91131a24cc244db9b10cc6523644c96"
server_key_iv: "9cacef1638e8941a54da392849496c02"
server_key_version: "encryptionkey@0"
I20260811 07:19:58.911397 4748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:19:58.921018 4748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:19:58.923249 4748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:19:58.923435 4748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:19:58.923674 4748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:19:58.924021 4748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:19:58.924082 4748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:58.924125 4748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:19:58.924153 4748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:19:58.930776 4748 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:43405
I20260811 07:19:58.930857 4978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:43405 every 8 connection(s)
I20260811 07:19:58.931197 4748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:19:58.937523 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 4748
Aug 11 07:19:58 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432798, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:19:58.942590 4524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.932005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:60291 (local address 127.9.142.190:45855)
0811 07:19:58.932071 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:58.932073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:58.932285 (+ 212us) server_negotiation.cc:407] Connection header received
0811 07:19:58.933171 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:58.933172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:58.933183 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:58.933235 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:58.934406 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.934929 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.936361 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.936600 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.936670 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.939124 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:58.939126 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:58.939126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:58.939135 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:58.940817 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.941306 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.941308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.941308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.941413 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.941794 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.941795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.941795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.941920 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:58.941984 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:58.942365 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 07:19:58.942440 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:19:58.942744 4982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.931988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:60291)
0811 07:19:58.932147 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:58.932191 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:58.933013 (+ 822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:58.933392 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:58.933397 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:58.934074 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:19:58.934299 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.934306 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.935040 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.935041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.936261 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.936264 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.936687 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.936688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.936809 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.937350 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:19:58.937359 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:19:58.939011 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:19:58.940935 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:58.940944 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:58.940946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:58.941201 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:58.941505 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:19:58.941507 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:19:58.941507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:19:58.941707 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:19:58.941998 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:19:58.942007 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:19:58.942197 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 07:19:58.942334 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 07:19:58.942562 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260811 07:19:58.943436 4979 heartbeater.cc:347] Connected to a master server at 127.9.142.190:45855
I20260811 07:19:58.943585 4979 heartbeater.cc:464] Registering TS with master...
I20260811 07:19:58.943887 4979 heartbeater.cc:511] Master 127.9.142.190:45855 requested a full tablet report, sending...
I20260811 07:19:58.944341 4187 ts_manager.cc:194] Registered new tserver with Master: cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405)
I20260811 07:19:58.944722 4187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:60291
I20260811 07:19:58.945914 4983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.938029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35220 (local address 127.9.142.190:45855)
0811 07:19:58.938145 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:58.938148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:58.938301 (+ 153us) server_negotiation.cc:407] Connection header received
0811 07:19:58.938393 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:58.938394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:58.938407 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:58.938495 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:58.939234 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.939848 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.940804 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.941035 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.941121 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.942566 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:58.942567 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:58.942567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:58.942574 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:58.944644 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.945095 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.945096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.945096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.945158 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:58.945387 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:58.945387 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:58.945388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:58.945508 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:58.945694 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:58.945732 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 07:19:58.945808 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":61,"threads_started":1}
I20260811 07:19:58.946617 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:19:58.949535 4983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.947009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35236 (local address 127.9.142.190:45855)
0811 07:19:58.947070 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:58.947072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:58.947142 (+ 70us) server_negotiation.cc:407] Connection header received
0811 07:19:58.947219 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:58.947219 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:58.947255 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:58.947340 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:19:58.947437 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.947953 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.948708 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.948962 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.949035 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.949221 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:19:58.949317 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:19:58.949400 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:58.949442 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 07:19:58.949463 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 07:19:58.949859 4187 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:35236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:19:58.951517 4187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:19:58.953810 4396 tablet_service.cc:1467] Processing CreateTablet for tablet 44c97cf255b94f2483d5c84e78332f56 (DEFAULT_TABLE table=test-table [id=90c09ee3e7b94d6094d8e05987d03f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:58.954042 4396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c97cf255b94f2483d5c84e78332f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:58.955672 4320 tablet_bootstrap.cc:492] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Bootstrap starting.
I20260811 07:19:58.956064 4320 tablet_bootstrap.cc:654] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:58.956651 4320 tablet_bootstrap.cc:492] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: No bootstrap required, opened a new log
I20260811 07:19:58.956707 4320 ts_tablet_manager.cc:1397] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:58.957067 4320 raft_consensus.cc:348] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:19:58.957157 4320 raft_consensus.cc:374] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:58.957216 4320 raft_consensus.cc:729] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f452ba5b2694c658075cf89b2259d6a, State: Initialized, Role: FOLLOWER
I20260811 07:19:58.957266 4320 consensus_queue.cc:260] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:19:58.957384 4320 ts_tablet_manager.cc:1428] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:19:58.957480 4527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.953371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:46157 (local address 127.0.0.1:56340)
0811 07:19:58.953423 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:58.953434 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:58.953477 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:58.954075 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:58.954076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:58.954077 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:58.954134 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.954135 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.955245 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.955246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.956298 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.956302 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.957197 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.957198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.957268 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.957293 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:19:58.957327 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 07:19:58.957376 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":10}
I20260811 07:19:58.957599 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.953427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:43405 (local address 127.0.0.1:58218)
0811 07:19:58.953535 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:58.953544 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:58.953592 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:58.954075 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:58.954076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:58.954078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:58.954136 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.954137 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.955306 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.955307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.956258 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:58.956262 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.957235 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.957236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:58.957302 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.957307 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:19:58.957341 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 07:19:58.957383 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"mutex_wait_us":6,"thread_start_us":62,"threads_started":1}
I20260811 07:19:58.957818 4995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.953655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58218 (local address 127.9.142.131:43405)
0811 07:19:58.953843 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:58.953847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:58.953867 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:19:58.953903 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:58.953906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:58.953921 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:58.954036 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:58.954206 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.955200 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.956369 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.957126 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.957591 (+ 465us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.957663 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:58.957691 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 07:19:58.957739 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":92,"threads_started":1}
I20260811 07:19:58.957934 4996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:58.953711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56340 (local address 127.9.142.130:46157)
0811 07:19:58.953877 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:58.953882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:58.953892 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:19:58.953934 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:58.953936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:58.953952 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:58.954219 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:58.954387 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.955152 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.956430 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:58.957086 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:58.957695 (+ 609us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:58.957762 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:58.957791 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 07:19:58.957828 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":89,"threads_started":1}
I20260811 07:19:58.958469 4856 tablet_service.cc:1467] Processing CreateTablet for tablet 44c97cf255b94f2483d5c84e78332f56 (DEFAULT_TABLE table=test-table [id=90c09ee3e7b94d6094d8e05987d03f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:58.958570 4641 tablet_service.cc:1467] Processing CreateTablet for tablet 44c97cf255b94f2483d5c84e78332f56 (DEFAULT_TABLE table=test-table [id=90c09ee3e7b94d6094d8e05987d03f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:19:58.958834 4856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c97cf255b94f2483d5c84e78332f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:58.958950 4641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c97cf255b94f2483d5c84e78332f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:19:58.961809 4998 tablet_bootstrap.cc:492] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: Bootstrap starting.
I20260811 07:19:58.961959 4999 tablet_bootstrap.cc:492] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: Bootstrap starting.
I20260811 07:19:58.962495 4998 tablet_bootstrap.cc:654] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:58.962563 4999 tablet_bootstrap.cc:654] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: Neither blocks nor log segments found. Creating new log.
I20260811 07:19:58.963021 4999 log.cc:824] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:58.963030 4998 log.cc:824] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:19:58.963796 4999 tablet_bootstrap.cc:492] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: No bootstrap required, opened a new log
I20260811 07:19:58.963862 4999 ts_tablet_manager.cc:1397] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:58.964020 4998 tablet_bootstrap.cc:492] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: No bootstrap required, opened a new log
I20260811 07:19:58.964100 4998 ts_tablet_manager.cc:1397] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:58.965528 4999 raft_consensus.cc:348] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:19:58.965674 4999 raft_consensus.cc:374] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:58.965696 4999 raft_consensus.cc:729] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0aa7dc1c64449118128d54e292dc7bc, State: Initialized, Role: FOLLOWER
I20260811 07:19:58.965651 4998 raft_consensus.cc:348] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:19:58.965827 4999 consensus_queue.cc:260] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:19:58.965857 4998 raft_consensus.cc:374] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:19:58.965906 4998 raft_consensus.cc:729] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd1e31462ee545059b92e9fdd28c75e9, State: Initialized, Role: FOLLOWER
I20260811 07:19:58.966022 4998 consensus_queue.cc:260] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:19:58.966128 4999 ts_tablet_manager.cc:1428] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:58.966145 4744 heartbeater.cc:503] Master 127.9.142.190:45855 was elected leader, sending a full tablet report...
I20260811 07:19:58.966313 4998 ts_tablet_manager.cc:1428] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:19:58.966454 4979 heartbeater.cc:503] Master 127.9.142.190:45855 was elected leader, sending a full tablet report...
W20260811 07:19:59.038002 4745 tablet.cc:2369] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:19:59.091018 5006 raft_consensus.cc:482] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:19:59.091223 5006 raft_consensus.cc:504] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:19:59.091785 5006 leader_election.cc:288] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157), 4f452ba5b2694c658075cf89b2259d6a (127.9.142.129:33045)
I20260811 07:19:59.095005 4528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:59.092093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:58899 (local address 127.9.142.129:33045)
0811 07:19:59.092146 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:59.092148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:59.092156 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:19:59.092187 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:59.092188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:59.092216 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:59.092291 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:59.092515 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.093149 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.094108 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.094626 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.094682 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:59.094737 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:59.094870 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 07:19:59.094924 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:19:59.095011 4982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:59.091972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33045 (local address 127.9.142.131:58899)
0811 07:19:59.092038 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:59.092050 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:59.092101 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:59.092316 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:59.092317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:59.092320 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:59.092415 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:59.092419 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.093219 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.093220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:59.094018 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:59.094020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.094701 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.094702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:59.094783 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:59.094787 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:59.094864 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 07:19:59.094927 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 07:19:59.095250 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:59.091992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:46157 (local address 127.9.142.131:56307)
0811 07:19:59.092216 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:59.092226 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:19:59.092281 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:19:59.092471 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:19:59.092472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:19:59.092474 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:19:59.092555 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:59.092557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.093356 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.093357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:59.094327 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:19:59.094330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.095014 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.095015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:19:59.095083 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:59.095087 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:19:59.095137 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 07:19:59.095180 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":32,"thread_start_us":104,"threads_started":1}
I20260811 07:19:59.095461 4996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:59.092105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:56307 (local address 127.9.142.130:46157)
0811 07:19:59.092151 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:59.092153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:59.092321 (+ 168us) server_negotiation.cc:407] Connection header received
0811 07:19:59.092352 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:59.092353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:59.092368 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:59.092437 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:19:59.092640 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.093273 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.094423 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.094913 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.094974 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:59.094981 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:59.095335 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 07:19:59.095380 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:19:59.095418 4431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c97cf255b94f2483d5c84e78332f56" candidate_uuid: "cd1e31462ee545059b92e9fdd28c75e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f452ba5b2694c658075cf89b2259d6a" is_pre_election: true
I20260811 07:19:59.095599 4431 raft_consensus.cc:2454] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd1e31462ee545059b92e9fdd28c75e9 in term 0.
I20260811 07:19:59.095889 4775 leader_election.cc:302] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f452ba5b2694c658075cf89b2259d6a, cd1e31462ee545059b92e9fdd28c75e9; no voters:
I20260811 07:19:59.095870 4669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c97cf255b94f2483d5c84e78332f56" candidate_uuid: "cd1e31462ee545059b92e9fdd28c75e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0aa7dc1c64449118128d54e292dc7bc" is_pre_election: true
I20260811 07:19:59.096032 4669 raft_consensus.cc:2454] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd1e31462ee545059b92e9fdd28c75e9 in term 0.
I20260811 07:19:59.096031 5006 raft_consensus.cc:2781] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:19:59.096127 5006 raft_consensus.cc:482] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:19:59.096143 5006 raft_consensus.cc:3037] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:59.096997 5006 raft_consensus.cc:504] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:19:59.097138 5006 leader_election.cc:288] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [CANDIDATE]: Term 1 election: Requested vote from peers c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157), 4f452ba5b2694c658075cf89b2259d6a (127.9.142.129:33045)
I20260811 07:19:59.097301 4431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c97cf255b94f2483d5c84e78332f56" candidate_uuid: "cd1e31462ee545059b92e9fdd28c75e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f452ba5b2694c658075cf89b2259d6a"
I20260811 07:19:59.097393 4431 raft_consensus.cc:3037] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:59.098191 4431 raft_consensus.cc:2454] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd1e31462ee545059b92e9fdd28c75e9 in term 1.
I20260811 07:19:59.098325 4669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c97cf255b94f2483d5c84e78332f56" candidate_uuid: "cd1e31462ee545059b92e9fdd28c75e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0aa7dc1c64449118128d54e292dc7bc"
I20260811 07:19:59.098380 4775 leader_election.cc:302] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f452ba5b2694c658075cf89b2259d6a, cd1e31462ee545059b92e9fdd28c75e9; no voters:
I20260811 07:19:59.098418 4669 raft_consensus.cc:3037] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:19:59.099208 4669 raft_consensus.cc:2454] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd1e31462ee545059b92e9fdd28c75e9 in term 1.
I20260811 07:19:59.099292 5006 raft_consensus.cc:2781] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:19:59.099464 5006 raft_consensus.cc:686] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 1 LEADER]: Becoming Leader. State: Replica: cd1e31462ee545059b92e9fdd28c75e9, State: Running, Role: LEADER
I20260811 07:19:59.099575 5006 consensus_queue.cc:237] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:19:59.100505 4187 catalog_manager.cc:5495] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131). New cstate: current_term: 1 leader_uuid: "cd1e31462ee545059b92e9fdd28c75e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } health_report { overall_health: UNKNOWN } } }
W20260811 07:19:59.133656 4521 tablet.cc:2369] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:19:59.139314 4995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:59.136846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58228 (local address 127.9.142.131:43405)
0811 07:19:59.136917 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:59.136920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:59.136930 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:19:59.137037 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:59.137038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:59.137057 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:59.137137 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:19:59.137279 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.137764 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.138536 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.138735 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.138820 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:59.138996 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:19:59.139042 (+ 46us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 07:19:59.139205 (+ 163us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58228: token expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 07:19:59.139401 4995 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58228: token expired
I20260811 07:19:59.145705 4983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:59.139689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35240 (local address 127.9.142.190:45855)
0811 07:19:59.139784 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:59.139786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:59.139794 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:19:59.139815 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:59.139816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:59.139825 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:59.139898 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:19:59.140418 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.140875 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.141544 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.141752 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.141826 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:59.143094 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:19:59.143095 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:19:59.143096 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:19:59.143103 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:19:59.144585 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:59.144962 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:59.144963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:59.144963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:59.145018 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:19:59.145227 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:19:59.145229 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:19:59.145229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:19:59.145343 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:19:59.145434 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:59.145532 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 07:19:59.145601 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:19:59.148736 4995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:59.146566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58232 (local address 127.9.142.131:43405)
0811 07:19:59.146617 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 07:19:59.146619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:19:59.146627 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:19:59.146647 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:19:59.146647 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:19:59.146663 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:19:59.146705 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:19:59.146824 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.147241 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.147999 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:19:59.148178 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:19:59.148244 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:19:59.148383 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:19:59.148533 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:19:59.148577 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 07:19:59.148627 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 07:19:59.148645 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 07:19:59.150741 4669 raft_consensus.cc:1261] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [term 1 FOLLOWER]: Refusing update from remote peer cd1e31462ee545059b92e9fdd28c75e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:59.150753 4431 raft_consensus.cc:1261] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Refusing update from remote peer cd1e31462ee545059b92e9fdd28c75e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:19:59.151170 5008 consensus_queue.cc:1035] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:59.151316 5006 consensus_queue.cc:1035] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:19:59.153972 5015 mvcc.cc:205] Tried to move back new op lower bound from 7317228745318547456 to 7317228745112719360. Current Snapshot: MvccSnapshot[applied={T|T < 7317228745318547456}]
I20260811 07:19:59.154326 5017 mvcc.cc:205] Tried to move back new op lower bound from 7317228745318547456 to 7317228745112719360. Current Snapshot: MvccSnapshot[applied={T|T < 7317228745318547456}]
I20260811 07:19:59.155762 4187 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:59.155872 4187 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:19:59.156607 4187 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Sending DeleteTablet for 3 replicas of tablet 44c97cf255b94f2483d5c84e78332f56
I20260811 07:19:59.156917 4396 tablet_service.cc:1514] Processing DeleteTablet for tablet 44c97cf255b94f2483d5c84e78332f56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:59 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:38328
I20260811 07:19:59.156961 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 4251
I20260811 07:19:59.156965 4856 tablet_service.cc:1514] Processing DeleteTablet for tablet 44c97cf255b94f2483d5c84e78332f56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:59 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:58218
I20260811 07:19:59.156963 4641 tablet_service.cc:1514] Processing DeleteTablet for tablet 44c97cf255b94f2483d5c84e78332f56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:19:59 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:56340
I20260811 07:19:59.162356 5030 tablet_replica.cc:330] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: stopping tablet replica
I20260811 07:19:59.162474 5030 raft_consensus.cc:2229] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:19:59.162564 5030 raft_consensus.cc:2258] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:59.164307 5030 ts_tablet_manager.cc:1905] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:59.166541 5030 ts_tablet_manager.cc:1918] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:59.166632 5030 log.cc:1196] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/44c97cf255b94f2483d5c84e78332f56
I20260811 07:19:59.167047 5030 ts_tablet_manager.cc:1939] T 44c97cf255b94f2483d5c84e78332f56 P cd1e31462ee545059b92e9fdd28c75e9: Deleting consensus metadata
I20260811 07:19:59.167570 5031 tablet_replica.cc:330] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: stopping tablet replica
I20260811 07:19:59.167712 5031 raft_consensus.cc:2229] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:19:59.167888 5031 raft_consensus.cc:2258] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:19:59.174773 4168 catalog_manager.cc:4841] TS cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405): tablet 44c97cf255b94f2483d5c84e78332f56 (table test-table [id=90c09ee3e7b94d6094d8e05987d03f05]) successfully deleted
I20260811 07:19:59.175318 5031 ts_tablet_manager.cc:1905] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:19:59.176893 5031 ts_tablet_manager.cc:1918] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:19:59.176990 5031 log.cc:1196] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/44c97cf255b94f2483d5c84e78332f56
I20260811 07:19:59.177258 5031 ts_tablet_manager.cc:1939] T 44c97cf255b94f2483d5c84e78332f56 P c0aa7dc1c64449118128d54e292dc7bc: Deleting consensus metadata
I20260811 07:19:59.177685 4169 catalog_manager.cc:4841] TS c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157): tablet 44c97cf255b94f2483d5c84e78332f56 (table test-table [id=90c09ee3e7b94d6094d8e05987d03f05]) successfully deleted
W20260811 07:19:59.180907 4168 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:33045 (error 108)
I20260811 07:19:59.181290 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 4522
I20260811 07:19:59.181434 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:19:59.181288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:33045 (local address 127.0.0.1:38336)
0811 07:19:59.181344 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 07:19:59.181395 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 07:19:59.183274 4168 catalog_manager.cc:4584] TS 4f452ba5b2694c658075cf89b2259d6a (127.9.142.129:33045): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 44c97cf255b94f2483d5c84e78332f56: Network error: Client connection negotiation failed: client connection to 127.9.142.129:33045: connect: Connection refused (error 111)
I20260811 07:19:59.190523 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 4748
I20260811 07:19:59.199100 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 4137
I20260811 07:20:19.208655 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45855
--webserver_interface=127.9.142.190
--webserver_port=35617
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:45855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:19.294134 5035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:19.294353 5035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:19.294375 5035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:19.295431 5035 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:20:19.295462 5035 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:20:19.295475 5035 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:20:19.295486 5035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:19.295499 5035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:19.295512 5035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:19.295523 5035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:19.295535 5035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:19.297000 5035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:45855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:45855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=35617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:19.297199 5035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:19.297377 5035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:19.302229 5045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:19.302237 5046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:19.302242 5052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:19.302597 5035 server_base.cc:1034] running on GCE node
I20260811 07:20:19.302889 5035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:19.303175 5035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:19.304337 5035 hybrid_clock.cc:648] HybridClock initialized: now 1786432819304318 us; error 37 us; skew 500 ppm
Aug 11 07:20:19 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432819, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:19.306957 5035 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:20:19.307442 5035 webserver.cc:460] Webserver started at http://127.9.142.190:35617/ using document root <none> and password file <none>
I20260811 07:20:19.307673 5035 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:19.307741 5035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:19.309109 5035 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:19.309839 5068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:19.310019 5035 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:19.310123 5035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "e3449208f7da4476b9b839036a02969b"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "6b0cf69c0b849c213a56a2298ad0de19"
server_key_iv: "5054f519f9d29c81ae4daf62c4e8e487"
server_key_version: "encryptionkey@0"
I20260811 07:20:19.310463 5035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:19.324465 5035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:19.326342 5035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:19.326493 5035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:19.330904 5035 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:45855
I20260811 07:20:19.330945 5162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:45855 every 8 connection(s)
I20260811 07:20:19.331346 5035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:19.332933 5164 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:20:19.333604 5164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Bootstrap starting.
I20260811 07:20:19.335497 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 5035
I20260811 07:20:19.335835 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:33045
--local_ip_for_outbound_sockets=127.9.142.129
--tserver_master_addrs=127.9.142.190:45855
--webserver_port=36507
--webserver_interface=127.9.142.129
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:20:19.343886 5164 log.cc:824] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:19.346257 5164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:20:19.346599 5164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: Bootstrap complete.
I20260811 07:20:19.349256 5164 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:20:19.349527 5164 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3449208f7da4476b9b839036a02969b, State: Initialized, Role: FOLLOWER
I20260811 07:20:19.349824 5164 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:20:19.349936 5164 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:19.349995 5164 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:19.350050 5164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:20:19.351222 5164 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:20:19.351353 5164 leader_election.cc:302] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3449208f7da4476b9b839036a02969b; no voters:
I20260811 07:20:19.351558 5164 leader_election.cc:288] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 07:20:19.351598 5169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:20:19.351792 5169 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [term 3 LEADER]: Becoming Leader. State: Replica: e3449208f7da4476b9b839036a02969b, State: Running, Role: LEADER
I20260811 07:20:19.351882 5164 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:19.352046 5169 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } }
I20260811 07:20:19.353101 5172 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3449208f7da4476b9b839036a02969b. Latest consensus state: current_term: 3 leader_uuid: "e3449208f7da4476b9b839036a02969b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } } }
I20260811 07:20:19.353102 5171 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e3449208f7da4476b9b839036a02969b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3449208f7da4476b9b839036a02969b" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 45855 } } }
I20260811 07:20:19.353240 5172 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:19.353255 5171 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:19.353832 5197 catalog_manager.cc:1259] Loaded cluster ID: 42db69fb5ff8473ca4d58cd260e428b5
I20260811 07:20:19.353873 5197 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: loading cluster ID for follower catalog manager: success
I20260811 07:20:19.354804 5197 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e3449208f7da4476b9b839036a02969b: acquiring CA information for follower catalog manager: success
F20260811 07:20:19.355157 5197 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f84cc71a9ad google::LogMessage::Fail() at ??:0
@ 0x7f84cc71d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f84cc71a4de google::LogMessage::Flush() at ??:0
@ 0x7f84cc71ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f84cee87104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f84d46736b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f84d4673989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f84d4673e4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f84d46768c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f84ce5dd954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f84cf4416db start_thread at ??:0
@ 0x7f84cb21861f clone at ??:0
W20260811 07:20:19.432600 5166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:19.432823 5166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:19.432866 5166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:19.433991 5166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:19.434052 5166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:19.434096 5166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:20:19.435539 5166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:33045
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=36507
--tserver_master_addrs=127.9.142.190:45855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:19.435824 5166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:19.436064 5166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:19.440958 5234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:19.440965 5231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:19.441273 5166 server_base.cc:1034] running on GCE node
W20260811 07:20:19.441048 5239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:19.441574 5166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:19.441849 5166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:19.443042 5166 hybrid_clock.cc:648] HybridClock initialized: now 1786432819443028 us; error 28 us; skew 500 ppm
Aug 11 07:20:19 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432819, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:19.446324 5166 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:20:19.446879 5166 webserver.cc:460] Webserver started at http://127.9.142.129:36507/ using document root <none> and password file <none>
I20260811 07:20:19.447134 5166 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:19.447201 5166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:19.449000 5166 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:19.449783 5254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:19.449972 5166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:19.450079 5166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "4f452ba5b2694c658075cf89b2259d6a"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "db8a484ed479d47188a968a110fef782"
server_key_iv: "b258fab01a802b21330e7dcb9dbf54f0"
server_key_version: "encryptionkey@0"
I20260811 07:20:19.450498 5166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:19.461740 5166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:19.464283 5166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:19.464447 5166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:19.464730 5166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:19.465227 5266 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:20:19.466701 5166 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:20:19.466776 5166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 07:20:19.466815 5166 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:20:19.467811 5166 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:20:19.467864 5166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:19.467911 5266 tablet_bootstrap.cc:492] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Bootstrap starting.
I20260811 07:20:19.475651 5166 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:33045
I20260811 07:20:19.476198 5166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:20:19.479580 5266 log.cc:824] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:19.479959 5458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:33045 every 8 connection(s)
I20260811 07:20:19.481773 5266 tablet_bootstrap.cc:492] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:20:19.482087 5266 tablet_bootstrap.cc:492] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Bootstrap complete.
I20260811 07:20:19.482087 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 5166
I20260811 07:20:19.482401 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:46157
--local_ip_for_outbound_sockets=127.9.142.130
--tserver_master_addrs=127.9.142.190:45855
--webserver_port=44471
--webserver_interface=127.9.142.130
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:20:19.483253 5266 ts_tablet_manager.cc:1397] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.012s
I20260811 07:20:19.484472 5266 raft_consensus.cc:348] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:20:19.484839 5266 raft_consensus.cc:729] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f452ba5b2694c658075cf89b2259d6a, State: Initialized, Role: FOLLOWER
I20260811 07:20:19.485025 5266 consensus_queue.cc:260] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:20:19.485321 5266 ts_tablet_manager.cc:1428] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a: Time spent starting tablet: real 0.002s user 0.003s sys 0.002s
W20260811 07:20:19.562158 5461 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:20:19.477031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:48375)
0811 07:20:19.477271 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:19.477327 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:19.478094 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:19.561932 (+ 83838us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":118,"threads_started":1}
W20260811 07:20:19.562484 5459 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:45855 (0 consecutive failures): Network error: Failed to ping master at 127.9.142.190:45855: Client connection negotiation failed: client connection to 127.9.142.190:45855: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:20:19.562848 5461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:19.562722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:60239)
0811 07:20:19.562776 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:19.562820 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 07:20:19.563241 5461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:19.563159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:41997)
0811 07:20:19.563202 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:19.563227 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 07:20:19.563371 5459 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:20:19.573257 5463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:19.573513 5463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:19.573558 5463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:19.574735 5463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:19.574803 5463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:19.574849 5463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:20:19.576629 5463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:46157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=44471
--tserver_master_addrs=127.9.142.190:45855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:19.576920 5463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:19.577175 5463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:19.582463 5480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:19.582530 5482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:19.582463 5479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:19.582626 5463 server_base.cc:1034] running on GCE node
I20260811 07:20:19.582962 5463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:19.583256 5463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:19.584462 5463 hybrid_clock.cc:648] HybridClock initialized: now 1786432819584452 us; error 43 us; skew 500 ppm
Aug 11 07:20:19 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432819, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:19.587188 5463 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:20:19.587634 5463 webserver.cc:460] Webserver started at http://127.9.142.130:44471/ using document root <none> and password file <none>
I20260811 07:20:19.587924 5463 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:19.587998 5463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:19.589494 5463 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:19.590155 5495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:19.590438 5463 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:19.590564 5463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "c0aa7dc1c64449118128d54e292dc7bc"
format_stamp: "Formatted at 2026-08-11 07:19:37 on dist-test-slave-7f01"
server_key: "d824285da53aff65dd6d70e8b4567a59"
server_key_iv: "b7d408fb90014ebdddb608239418038a"
server_key_version: "encryptionkey@0"
I20260811 07:20:19.590940 5463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:19.607031 5463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:19.609161 5463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:19.609355 5463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:19.609633 5463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:19.609980 5463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:19.610039 5463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:19.610085 5463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:19.610118 5463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:19.616721 5463 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:46157
I20260811 07:20:19.616771 5710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:46157 every 8 connection(s)
I20260811 07:20:19.617151 5463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:20:19.618234 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:19.617841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:55091)
0811 07:20:19.618006 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:19.618083 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
W20260811 07:20:19.618682 5712 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:45855 (0 consecutive failures): Network error: Failed to ping master at 127.9.142.190:45855: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
I20260811 07:20:19.618984 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:19.618879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:56929)
0811 07:20:19.618931 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:19.618958 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 07:20:19.619300 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:19.619203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:43055)
0811 07:20:19.619248 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:19.619277 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 07:20:19.619429 5712 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:20:19.619413 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 5463
I20260811 07:20:19.619724 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:43405
--local_ip_for_outbound_sockets=127.9.142.131
--tserver_master_addrs=127.9.142.190:45855
--webserver_port=42329
--webserver_interface=127.9.142.131
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:19.707612 5719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:19.707922 5719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:19.707969 5719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:19.709136 5719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:19.709208 5719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:19.709252 5719 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:20:19.710734 5719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:43405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=42329
--tserver_master_addrs=127.9.142.190:45855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:19.711028 5719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:19.711265 5719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:19.716380 5727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:19.716391 5726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:19.716696 5719 server_base.cc:1034] running on GCE node
W20260811 07:20:19.716449 5729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:19.717008 5719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:19.717267 5719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:19.718461 5719 hybrid_clock.cc:648] HybridClock initialized: now 1786432819718449 us; error 31 us; skew 500 ppm
Aug 11 07:20:19 dist-test-slave-7f01 krb5kdc[3138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432819, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:19.721695 5719 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:20:19.722227 5719 webserver.cc:460] Webserver started at http://127.9.142.131:42329/ using document root <none> and password file <none>
I20260811 07:20:19.722472 5719 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:19.722545 5719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:19.724045 5719 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:19.724810 5743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:19.725034 5719 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:19.725148 5719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "cd1e31462ee545059b92e9fdd28c75e9"
format_stamp: "Formatted at 2026-08-11 07:19:38 on dist-test-slave-7f01"
server_key: "b91131a24cc244db9b10cc6523644c96"
server_key_iv: "9cacef1638e8941a54da392849496c02"
server_key_version: "encryptionkey@0"
I20260811 07:20:19.725526 5719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:19.771013 5719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:19.773778 5719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:19.773995 5719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:19.774281 5719 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:19.774631 5719 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:19.774685 5719 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:19.774729 5719 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:19.774768 5719 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:19.781401 5719 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:43405
I20260811 07:20:19.781447 5961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:43405 every 8 connection(s)
I20260811 07:20:19.781836 5719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:20:19.783003 5965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:19.782496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:37551)
0811 07:20:19.782727 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:19.782833 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
W20260811 07:20:19.783465 5962 heartbeater.cc:644] Failed to heartbeat to 127.9.142.190:45855 (0 consecutive failures): Network error: Failed to ping master at 127.9.142.190:45855: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
I20260811 07:20:19.783843 5965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:19.783725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:59579)
0811 07:20:19.783791 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:19.783822 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 07:20:19.784214 5965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:19.784133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:44169)
0811 07:20:19.784172 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:19.784197 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 07:20:19.784382 5962 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:20:19.786844 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 5719
I20260811 07:20:20.564188 5967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:20.563889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:60251)
0811 07:20:20.564060 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:20.564113 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":75,"threads_started":1}
I20260811 07:20:20.620159 5968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:20.619908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:46091)
0811 07:20:20.620060 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:20.620104 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":67,"threads_started":1}
I20260811 07:20:20.770541 5969 raft_consensus.cc:482] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:20.770704 5969 raft_consensus.cc:504] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:20:20.771072 5969 leader_election.cc:288] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157), cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405)
Aug 11 07:20:20 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432819, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.130@KRBTEST.COM
Aug 11 07:20:20 dist-test-slave-7f01 krb5kdc[3138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432819, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.131@KRBTEST.COM
I20260811 07:20:20.784950 5980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:20.784709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:50641)
0811 07:20:20.784844 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:20.784893 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
I20260811 07:20:20.786897 5979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:20.771362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:54331 (local address 127.9.142.131:43405)
0811 07:20:20.771580 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:20.771590 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:20.771608 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:20:20.772116 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:20.772119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:20.772188 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:20.772354 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:20.773168 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:20.774119 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:20.775057 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:20.775490 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:20.775626 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:20.783193 (+ 7567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:20.783197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:20.783197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:20.783207 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:20.784906 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:20.785483 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:20.785486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:20.785486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:20.785585 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:20.785894 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:20.785895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:20.785895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:20.786206 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:20.786298 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:20.786671 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 07:20:20.786828 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":75,"threads_started":1}
I20260811 07:20:20.786969 5967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:20.771236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:46157 (local address 127.9.142.129:34463)
0811 07:20:20.771294 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:20.771309 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:20.771371 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:20.772411 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:20.772414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:20.772841 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:20.773040 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:20.773046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:20.774174 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:20.774175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:20.774958 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:20.774961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:20.775570 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:20.775571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:20.775689 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:20.780871 (+ 5182us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:20.780880 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:20.782525 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:20.784946 (+ 2421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:20.784954 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:20.784957 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:20.785308 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:20.785616 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:20.785617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:20.785617 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:20.785802 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:20.786284 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:20.786292 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:20.786474 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 07:20:20.786604 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 07:20:20.786851 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":33}
I20260811 07:20:20.787202 5972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:20.771236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:43405 (local address 127.9.142.129:54331)
0811 07:20:20.771397 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:20.771407 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:20.771452 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:20.772411 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:20.772414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:20.772838 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:20.773040 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:20.773046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:20.774229 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:20.774230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:20.774960 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:20.774963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:20.775593 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:20.775595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:20.775692 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:20.780927 (+ 5235us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:20.780932 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:20.783078 (+ 2146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:20.785024 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:20.785025 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:20.785026 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:20.785387 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:20.785652 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:20.785653 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:20.785653 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:20.785802 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:20.786284 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:20.786292 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:20.786456 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 07:20:20.786604 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 07:20:20.786912 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":223,"thread_start_us":87,"threads_started":1}
I20260811 07:20:20.787385 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:20.771371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:34463 (local address 127.9.142.130:46157)
0811 07:20:20.771552 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:20.771563 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:20.771594 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:20:20.772175 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:20.772177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:20.772216 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:20.772362 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:20.773173 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:20.774059 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:20.775048 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:20.775465 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:20.775597 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:20.782648 (+ 7051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:20.782653 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:20.782654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:20.782668 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:20.784773 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:20.785393 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:20.785397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:20.785397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:20.785538 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:20.785894 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:20.785895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:20.785895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:20.786206 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:20.786298 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:20.787097 (+ 799us) server_negotiation.cc:299] Negotiation successful
0811 07:20:20.787253 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":84,"threads_started":1}
W20260811 07:20:20.787916 5260 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
W20260811 07:20:20.788070 5262 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
I20260811 07:20:20.788138 5262 leader_election.cc:302] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f452ba5b2694c658075cf89b2259d6a; no voters: c0aa7dc1c64449118128d54e292dc7bc, cd1e31462ee545059b92e9fdd28c75e9
I20260811 07:20:20.788249 5969 raft_consensus.cc:2726] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:20:21.565130 5981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:21.564787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:54649)
0811 07:20:21.564952 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:21.565045 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
I20260811 07:20:21.620972 5982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:21.620715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:34271)
0811 07:20:21.620882 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:21.620923 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":67,"threads_started":1}
I20260811 07:20:21.785710 5984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:21.785480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:36319)
0811 07:20:21.785616 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:21.785646 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260811 07:20:22.565944 5986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:22.565714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:42431)
0811 07:20:22.565845 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:22.565890 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260811 07:20:22.621670 5987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:22.621438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:39709)
0811 07:20:22.621566 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:22.621602 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260811 07:20:22.786360 5989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:22.786143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:34615)
0811 07:20:22.786279 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:22.786316 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260811 07:20:22.860219 5991 raft_consensus.cc:482] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:22.860333 5991 raft_consensus.cc:504] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:20:22.860793 5991 leader_election.cc:288] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157), cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405)
W20260811 07:20:22.861466 5262 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
W20260811 07:20:22.861562 5260 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
I20260811 07:20:22.861645 5260 leader_election.cc:302] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f452ba5b2694c658075cf89b2259d6a; no voters: c0aa7dc1c64449118128d54e292dc7bc, cd1e31462ee545059b92e9fdd28c75e9
I20260811 07:20:22.861743 5991 raft_consensus.cc:2726] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:20:23.566730 5996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:23.566491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:46995)
0811 07:20:23.566639 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:23.566677 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
I20260811 07:20:23.622414 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:23.622142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:58731)
0811 07:20:23.622305 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:23.622357 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
I20260811 07:20:23.787107 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:23.786842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:59425)
0811 07:20:23.787002 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:23.787041 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":74,"threads_started":1}
I20260811 07:20:24.567556 6004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:24.567299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:53425)
0811 07:20:24.567467 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:24.567503 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":106,"threads_started":1}
I20260811 07:20:24.623203 6012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:24.622933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:51805)
0811 07:20:24.623116 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:24.623152 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":124,"threads_started":1}
I20260811 07:20:24.787881 6013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:24.787598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:51823)
0811 07:20:24.787797 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:24.787837 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260811 07:20:25.395314 6015 raft_consensus.cc:482] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:25.395439 6015 raft_consensus.cc:504] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:20:25.395699 6015 leader_election.cc:288] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157), cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405)
W20260811 07:20:25.396139 5262 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
W20260811 07:20:25.396225 5260 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
I20260811 07:20:25.396328 5260 leader_election.cc:302] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f452ba5b2694c658075cf89b2259d6a; no voters: c0aa7dc1c64449118128d54e292dc7bc, cd1e31462ee545059b92e9fdd28c75e9
I20260811 07:20:25.396445 6015 raft_consensus.cc:2726] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:20:25.568269 6017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:25.568048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:36379)
0811 07:20:25.568177 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:25.568215 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260811 07:20:25.623879 6018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:25.623654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:57221)
0811 07:20:25.623801 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:25.623838 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":62,"threads_started":1}
I20260811 07:20:25.788568 6019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:25.788342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:51701)
0811 07:20:25.788481 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:25.788521 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":72,"threads_started":1}
I20260811 07:20:26.569062 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:26.568776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:51337)
0811 07:20:26.568956 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:26.569002 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":79,"threads_started":1}
I20260811 07:20:26.624730 6021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:26.624315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:36145)
0811 07:20:26.624549 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:26.624672 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":76,"threads_started":1}
I20260811 07:20:26.789193 6023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:26.788990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:60675)
0811 07:20:26.789116 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:26.789151 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260811 07:20:27.569850 6025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:27.569640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:50283)
0811 07:20:27.569763 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:27.569796 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260811 07:20:27.625495 6028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:27.625278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:36997)
0811 07:20:27.625415 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:27.625451 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260811 07:20:27.789953 6030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:27.789706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:38493)
0811 07:20:27.789853 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:27.789904 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":67,"threads_started":1}
I20260811 07:20:28.570658 6031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:28.570412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:53483)
0811 07:20:28.570565 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:28.570603 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260811 07:20:28.626261 6032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:28.626026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:53787)
0811 07:20:28.626173 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:28.626212 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260811 07:20:28.756595 6035 raft_consensus.cc:482] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:28.756731 6035 raft_consensus.cc:504] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:20:28.756953 6035 leader_election.cc:288] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157), cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405)
W20260811 07:20:28.757370 5260 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
W20260811 07:20:28.757458 5262 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
I20260811 07:20:28.757505 5262 leader_election.cc:302] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f452ba5b2694c658075cf89b2259d6a; no voters: c0aa7dc1c64449118128d54e292dc7bc, cd1e31462ee545059b92e9fdd28c75e9
I20260811 07:20:28.757601 6035 raft_consensus.cc:2726] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:20:28.790789 6037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:28.790561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:49943)
0811 07:20:28.790694 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:28.790745 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":76,"threads_started":1}
I20260811 07:20:29.571523 6039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:29.571262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:46281)
0811 07:20:29.571416 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:29.571455 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":74,"threads_started":1}
I20260811 07:20:29.627097 6041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:29.626850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:41941)
0811 07:20:29.627003 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:29.627048 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
I20260811 07:20:29.791703 6042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:29.791355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:55821)
0811 07:20:29.791610 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:29.791651 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":172,"threads_started":1}
I20260811 07:20:30.572243 6043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:30.572021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:34551)
0811 07:20:30.572152 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:30.572191 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260811 07:20:30.628051 6045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:30.627703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:41095)
0811 07:20:30.627955 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:30.627998 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":153,"threads_started":1}
I20260811 07:20:30.792454 6046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:30.792209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:57839)
0811 07:20:30.792357 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:30.792403 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":67,"threads_started":1}
I20260811 07:20:31.572993 6047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:31.572737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:34237)
0811 07:20:31.572902 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:31.572938 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
I20260811 07:20:31.628742 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:31.628540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:55863)
0811 07:20:31.628662 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:31.628698 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260811 07:20:31.793236 6054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:31.793003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:54541)
0811 07:20:31.793144 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:31.793185 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":68,"threads_started":1}
I20260811 07:20:32.573788 6055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:32.573557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:45873)
0811 07:20:32.573695 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:32.573735 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
I20260811 07:20:32.629561 6060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:32.629245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:43169)
0811 07:20:32.629456 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:32.629507 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":68,"threads_started":1}
I20260811 07:20:32.794003 6064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:32.793724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:47297)
0811 07:20:32.793904 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:32.793951 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":132,"threads_started":1}
I20260811 07:20:33.574626 6067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:33.574361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:51101)
0811 07:20:33.574529 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:33.574571 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":69,"threads_started":1}
I20260811 07:20:33.630275 6069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:33.630041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:40581)
0811 07:20:33.630184 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:33.630224 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
I20260811 07:20:33.794745 6070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:33.794540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:53055)
0811 07:20:33.794657 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:33.794694 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":69,"threads_started":1}
I20260811 07:20:34.493324 6071 raft_consensus.cc:482] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:34.493453 6071 raft_consensus.cc:504] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0aa7dc1c64449118128d54e292dc7bc" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46157 } } peers { permanent_uuid: "cd1e31462ee545059b92e9fdd28c75e9" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 43405 } } peers { permanent_uuid: "4f452ba5b2694c658075cf89b2259d6a" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 33045 } }
I20260811 07:20:34.493772 6071 leader_election.cc:288] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157), cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405)
W20260811 07:20:34.494168 5260 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd1e31462ee545059b92e9fdd28c75e9 (127.9.142.131:43405): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
W20260811 07:20:34.494262 5262 leader_election.cc:341] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c0aa7dc1c64449118128d54e292dc7bc (127.9.142.130:46157): Not found: Tablet not found: 44c97cf255b94f2483d5c84e78332f56
I20260811 07:20:34.494311 5262 leader_election.cc:302] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f452ba5b2694c658075cf89b2259d6a; no voters: c0aa7dc1c64449118128d54e292dc7bc, cd1e31462ee545059b92e9fdd28c75e9
I20260811 07:20:34.494392 6071 raft_consensus.cc:2726] T 44c97cf255b94f2483d5c84e78332f56 P 4f452ba5b2694c658075cf89b2259d6a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:20:34.575598 6072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:34.575304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.129:40043)
0811 07:20:34.575504 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:34.575547 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":104,"threads_started":1}
I20260811 07:20:34.630987 6075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:34.630756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.130:49927)
0811 07:20:34.630893 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:34.630930 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
I20260811 07:20:34.790637 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 5166
I20260811 07:20:34.797097 6076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:34.795930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:45855 (local address 127.9.142.131:57221)
0811 07:20:34.796991 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:34.797038 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.190:45855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1023,"thread_start_us":975,"threads_started":1}
I20260811 07:20:34.810653 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 5463
I20260811 07:20:34.820556 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 5719
2026-08-11T07:20:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58796 ms)
[----------] 30 tests from SecurityITest (242688 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:34 dist-test-slave-7f01 krb5kdc[6080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:34 dist-test-slave-7f01 krb5kdc[6080](info): set up 2 sockets
Aug 11 07:20:34 dist-test-slave-7f01 krb5kdc[6080](info): commencing operation
krb5kdc: starting...
W20260811 07:20:36.162460 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:36 dist-test-slave-7f01 krb5kdc[6080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:20:36.290283 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:43963
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:43963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:36.376293 6104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:36.376531 6104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:36.376569 6104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:36.377684 6104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:36.377749 6104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:36.377774 6104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:36.377796 6104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:36.377825 6104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:36.379288 6104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:43963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:43963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:36.379570 6104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:36.379814 6104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:36.384954 6116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:36.384930 6117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:36.384966 6104 server_base.cc:1034] running on GCE node
W20260811 07:20:36.384935 6119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:36.385502 6104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:36.385799 6104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:36.386945 6104 hybrid_clock.cc:648] HybridClock initialized: now 1786432836386922 us; error 35 us; skew 500 ppm
Aug 11 07:20:36 dist-test-slave-7f01 krb5kdc[6080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432836, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:36.389490 6104 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:20:36.389912 6104 webserver.cc:460] Webserver started at http://127.9.142.190:45759/ using document root <none> and password file <none>
I20260811 07:20:36.390133 6104 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:36.390180 6104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:36.390307 6104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:36.391355 6104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "681733fd00b846b4b055a1d9f9d96d5e"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "b96ad2928b27ac0b2e710647d556e75a"
server_key_iv: "8d4eb882851836e89cc3dd38f835914f"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.391791 6104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "681733fd00b846b4b055a1d9f9d96d5e"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "b96ad2928b27ac0b2e710647d556e75a"
server_key_iv: "8d4eb882851836e89cc3dd38f835914f"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.393177 6104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:20:36.393925 6134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:36.394093 6104 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:20:36.394210 6104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "681733fd00b846b4b055a1d9f9d96d5e"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "b96ad2928b27ac0b2e710647d556e75a"
server_key_iv: "8d4eb882851836e89cc3dd38f835914f"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.394289 6104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:36.444087 6104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:36.446312 6104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:36.446485 6104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:36.451022 6104 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:43963
I20260811 07:20:36.451059 6217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:43963 every 8 connection(s)
I20260811 07:20:36.451468 6104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:36.452414 6218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:36.454753 6218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e: Bootstrap starting.
I20260811 07:20:36.455314 6218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:36.455572 6218 log.cc:824] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:36.456302 6218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e: No bootstrap required, opened a new log
I20260811 07:20:36.456866 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 6104
I20260811 07:20:36.457063 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:36.457279 9786 external_mini_cluster.cc:1428] Setting key 9340f8b8a10d8621045b2c6dff7ccd70
I20260811 07:20:36.458814 6218 raft_consensus.cc:348] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681733fd00b846b4b055a1d9f9d96d5e" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43963 } }
I20260811 07:20:36.459015 6218 raft_consensus.cc:374] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:36.459060 6218 raft_consensus.cc:729] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681733fd00b846b4b055a1d9f9d96d5e, State: Initialized, Role: FOLLOWER
I20260811 07:20:36.459251 6218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681733fd00b846b4b055a1d9f9d96d5e" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43963 } }
I20260811 07:20:36.459344 6218 raft_consensus.cc:388] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:36.459369 6218 raft_consensus.cc:482] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:36.459446 6218 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:36.460640 6218 raft_consensus.cc:504] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681733fd00b846b4b055a1d9f9d96d5e" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43963 } }
I20260811 07:20:36.460762 6218 leader_election.cc:302] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 681733fd00b846b4b055a1d9f9d96d5e; no voters:
I20260811 07:20:36.460937 6218 leader_election.cc:288] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:36.460991 6224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:36.461208 6218 sys_catalog.cc:564] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:36.461249 6224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [term 1 LEADER]: Becoming Leader. State: Replica: 681733fd00b846b4b055a1d9f9d96d5e, State: Running, Role: LEADER
I20260811 07:20:36.461402 6224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681733fd00b846b4b055a1d9f9d96d5e" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43963 } }
I20260811 07:20:36.461831 6226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "681733fd00b846b4b055a1d9f9d96d5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681733fd00b846b4b055a1d9f9d96d5e" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43963 } } }
I20260811 07:20:36.461839 6228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 681733fd00b846b4b055a1d9f9d96d5e. Latest consensus state: current_term: 1 leader_uuid: "681733fd00b846b4b055a1d9f9d96d5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681733fd00b846b4b055a1d9f9d96d5e" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43963 } } }
I20260811 07:20:36.461928 6226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:36.461938 6228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e [sys.catalog]: This master's current role is: LEADER
W20260811 07:20:36.463310 6246 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:20:36.463375 6246 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:20:36.463461 6239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:36.463691 6239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:36.465432 6239 catalog_manager.cc:1347] Generated new cluster ID: ed52f613b8254ae3a10bb14c897ea4fc
I20260811 07:20:36.465498 6239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:20:36 dist-test-slave-7f01 krb5kdc[6080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:36.470202 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:36.457868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35464 (local address 127.9.142.190:43963)
0811 07:20:36.458107 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:36.458117 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:36.458155 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:20:36.458767 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:36.458777 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:36.458844 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:36.459001 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:36.459862 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.461357 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.462601 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.463268 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.463398 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:36.466332 (+ 2934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:36.466336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:36.466336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:36.466348 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:36.468443 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:36.468845 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:36.468848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:36.468848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:36.469004 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:36.469218 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:36.469219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:36.469219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:36.469564 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:36.469759 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:36.469833 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 07:20:36.469978 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":113,"threads_started":1}
I20260811 07:20:36.480878 6239 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:36.481613 6239 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:36.486865 6239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e: Generated new TSK 0
I20260811 07:20:36.487053 6239 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:20:36.518313 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:43963
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:36.605644 6254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:36.605849 6254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:36.605873 6254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:36.607030 6254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:36.607075 6254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:36.607101 6254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:20:36.608583 6254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:43963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:36.608826 6254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:36.609095 6254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:36.614209 6262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:36.614431 6265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:36.614494 6254 server_base.cc:1034] running on GCE node
W20260811 07:20:36.614202 6273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:36.614817 6254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:36.615018 6254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:36.616176 6254 hybrid_clock.cc:648] HybridClock initialized: now 1786432836616156 us; error 37 us; skew 500 ppm
Aug 11 07:20:36 dist-test-slave-7f01 krb5kdc[6080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432836, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:36.618937 6254 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:20:36.619423 6254 webserver.cc:460] Webserver started at http://127.9.142.129:43241/ using document root <none> and password file <none>
I20260811 07:20:36.619692 6254 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:36.619791 6254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:36.619956 6254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:36.621016 6254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "f58f48116dc7423182dbb768390ea775"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "2e1504919b6ad627d537af16791e0ce3"
server_key_iv: "c92494bb5f0c36c58a6782aa38a516d2"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.621393 6254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "f58f48116dc7423182dbb768390ea775"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "2e1504919b6ad627d537af16791e0ce3"
server_key_iv: "c92494bb5f0c36c58a6782aa38a516d2"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.622874 6254 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:20:36.624040 6293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:36.624265 6254 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:36.624387 6254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "f58f48116dc7423182dbb768390ea775"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "2e1504919b6ad627d537af16791e0ce3"
server_key_iv: "c92494bb5f0c36c58a6782aa38a516d2"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.624469 6254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:36.660485 6254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:36.663522 6254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:36.663707 6254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:36.664018 6254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:36.664379 6254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:36.664438 6254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:36.664482 6254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:36.664512 6254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:36.670706 6254 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:36423
I20260811 07:20:36.670799 6496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:36423 every 8 connection(s)
I20260811 07:20:36.671324 6254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:20:36.674749 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 6254
I20260811 07:20:36.674882 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:20:36.675102 9786 external_mini_cluster.cc:1428] Setting key 043f2ebbb140fc0dff1d853c533426c9
Aug 11 07:20:36 dist-test-slave-7f01 krb5kdc[6080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432836, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:36.683101 6500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:36.672155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:43963 (local address 127.9.142.129:50429)
0811 07:20:36.672574 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:36.672632 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:36.673218 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:36.673553 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:36.673563 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:36.674218 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:36.674457 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:36.674463 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.675414 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.675416 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:36.676676 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:36.676680 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.677138 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.677139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:36.677291 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:36.678007 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:36.678021 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:36.679489 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:36.681609 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:36.681617 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:36.681619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:36.681865 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:36.682116 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:36.682117 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:36.682117 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:36.682225 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:36.682544 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:36.682551 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:36.682679 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 07:20:36.682772 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 07:20:36.682919 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":110,"threads_started":1}
I20260811 07:20:36.683092 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:36.672318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:50429 (local address 127.9.142.190:43963)
0811 07:20:36.672533 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:36.672536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:36.672724 (+ 188us) server_negotiation.cc:407] Connection header received
0811 07:20:36.673350 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:36.673362 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:36.673381 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:36.673453 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:36.674598 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.675271 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.676794 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.677032 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.677107 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:36.679592 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:36.679593 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:36.679594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:36.679607 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:36.681519 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:36.681950 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:36.681951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:36.681952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:36.682036 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:36.682296 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:36.682297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:36.682297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:36.682465 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:36.682548 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:36.682826 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 07:20:36.682938 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260811 07:20:36.683681 6497 heartbeater.cc:347] Connected to a master server at 127.9.142.190:43963
I20260811 07:20:36.683835 6497 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:36.684051 6497 heartbeater.cc:511] Master 127.9.142.190:43963 requested a full tablet report, sending...
I20260811 07:20:36.684733 6157 ts_manager.cc:194] Registered new tserver with Master: f58f48116dc7423182dbb768390ea775 (127.9.142.129:36423)
I20260811 07:20:36.685714 6157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:50429
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:20:36.709141 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:43963
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:36.798252 6505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:36.798508 6505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:36.798552 6505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:36.799839 6505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:36.799909 6505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:36.799962 6505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:20:36.801589 6505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:43963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:36.801894 6505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:36.802150 6505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:36.807606 6519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:36.807638 6513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:36.807816 6505 server_base.cc:1034] running on GCE node
W20260811 07:20:36.808055 6512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:36.808398 6505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:36.808714 6505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:36.809898 6505 hybrid_clock.cc:648] HybridClock initialized: now 1786432836809873 us; error 42 us; skew 500 ppm
Aug 11 07:20:36 dist-test-slave-7f01 krb5kdc[6080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432836, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:36.812726 6505 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:20:36.813102 6505 webserver.cc:460] Webserver started at http://127.9.142.130:33795/ using document root <none> and password file <none>
I20260811 07:20:36.813341 6505 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:36.813385 6505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:36.813476 6505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:36.814457 6505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "1c370aa8f717411382fd3bf004e6e52c"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "fcd0f0bea3b678c80f62a1ef42b885c3"
server_key_iv: "42d91f8ed2a06443af279a48191620bf"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.814766 6505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "1c370aa8f717411382fd3bf004e6e52c"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "fcd0f0bea3b678c80f62a1ef42b885c3"
server_key_iv: "42d91f8ed2a06443af279a48191620bf"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.816417 6505 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:20:36.817143 6529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:36.817384 6505 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:36.817469 6505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "1c370aa8f717411382fd3bf004e6e52c"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "fcd0f0bea3b678c80f62a1ef42b885c3"
server_key_iv: "42d91f8ed2a06443af279a48191620bf"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.817526 6505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:36.831538 6505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:36.834257 6505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:36.834381 6505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:36.834574 6505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:36.834848 6505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:36.834882 6505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:36.834905 6505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:36.834925 6505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:36.841557 6505 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:44011
I20260811 07:20:36.841635 6738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:44011 every 8 connection(s)
I20260811 07:20:36.841899 6505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:20:36.845656 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 6505
I20260811 07:20:36.845752 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:20:36.845995 9786 external_mini_cluster.cc:1428] Setting key d6fada94899c52e225488bc56892afe9
Aug 11 07:20:36 dist-test-slave-7f01 krb5kdc[6080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432836, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:36.852216 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:36.842596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:41271 (local address 127.9.142.190:43963)
0811 07:20:36.842688 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:36.842691 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:36.842909 (+ 218us) server_negotiation.cc:407] Connection header received
0811 07:20:36.843457 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:36.843458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:36.843472 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:36.843533 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:36.844508 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.845051 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.846285 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.846500 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.846588 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:36.848970 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:36.848971 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:36.848972 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:36.848979 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:36.850576 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:36.851093 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:36.851094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:36.851095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:36.851167 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:36.851521 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:36.851521 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:36.851522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:36.851638 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:36.851695 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:36.852069 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 07:20:36.852149 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 07:20:36.852488 6749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:36.842548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:43963 (local address 127.9.142.130:41271)
0811 07:20:36.842747 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:36.842796 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:36.843346 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:36.843602 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:36.843607 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:36.844206 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:36.844397 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:36.844402 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.845159 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.845161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:36.846186 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:36.846190 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:36.846603 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:36.846604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:36.846773 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:36.847306 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:36.847322 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:36.848865 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:36.850663 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:36.850672 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:36.850674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:36.850999 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:36.851244 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:36.851245 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:36.851246 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:36.851431 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:36.851713 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:36.851722 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:36.851915 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 07:20:36.852043 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 07:20:36.852229 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":105,"threads_started":1}
I20260811 07:20:36.853021 6741 heartbeater.cc:347] Connected to a master server at 127.9.142.190:43963
I20260811 07:20:36.853135 6741 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:36.853363 6741 heartbeater.cc:511] Master 127.9.142.190:43963 requested a full tablet report, sending...
I20260811 07:20:36.853753 6157 ts_manager.cc:194] Registered new tserver with Master: 1c370aa8f717411382fd3bf004e6e52c (127.9.142.130:44011)
I20260811 07:20:36.854151 6157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:41271
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:20:36.875401 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:43963
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:45773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:36.964272 6755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:36.964486 6755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:36.964510 6755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:36.965627 6755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:36.965669 6755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:36.965723 6755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:20:36.967211 6755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:45773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:43963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:36.967471 6755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:36.967703 6755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:36.972707 6767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:36.972735 6765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:36.972755 6764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:36.972945 6755 server_base.cc:1034] running on GCE node
I20260811 07:20:36.973163 6755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:36.973351 6755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:36.974486 6755 hybrid_clock.cc:648] HybridClock initialized: now 1786432836974472 us; error 28 us; skew 500 ppm
Aug 11 07:20:36 dist-test-slave-7f01 krb5kdc[6080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432836, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:36.977077 6755 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:20:36.977491 6755 webserver.cc:460] Webserver started at http://127.9.142.131:38221/ using document root <none> and password file <none>
I20260811 07:20:36.977722 6755 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:36.977768 6755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:36.977929 6755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:36.978912 6755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "ddae7d6626a6411896a093fa43adc8f5"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "babce9049e21b7c58ffaa839ee30e4a8"
server_key_iv: "65bf0df5e98efab7b8055ef5a7c71b42"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.979279 6755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "ddae7d6626a6411896a093fa43adc8f5"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "babce9049e21b7c58ffaa839ee30e4a8"
server_key_iv: "65bf0df5e98efab7b8055ef5a7c71b42"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.980700 6755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:20:36.981446 6779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:36.981743 6755 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:20:36.981854 6755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "ddae7d6626a6411896a093fa43adc8f5"
format_stamp: "Formatted at 2026-08-11 07:20:36 on dist-test-slave-7f01"
server_key: "babce9049e21b7c58ffaa839ee30e4a8"
server_key_iv: "65bf0df5e98efab7b8055ef5a7c71b42"
server_key_version: "encryptionkey@0"
I20260811 07:20:36.981930 6755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:37.003180 6755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:37.005590 6755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:37.005756 6755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:37.006004 6755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:37.006319 6755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:37.006374 6755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:37.006417 6755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:37.006445 6755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:37.012862 6755 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:37529
I20260811 07:20:37.012954 6984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:37529 every 8 connection(s)
I20260811 07:20:37.013267 6755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
Aug 11 07:20:37 dist-test-slave-7f01 krb5kdc[6080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432836, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:37.021241 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 6755
I20260811 07:20:37.021355 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:20:37.021575 9786 external_mini_cluster.cc:1428] Setting key 9096c32eb40b9defa5d08213c41ace82
I20260811 07:20:37.022373 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.014041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:43061 (local address 127.9.142.190:43963)
0811 07:20:37.014085 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.014086 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.014311 (+ 225us) server_negotiation.cc:407] Connection header received
0811 07:20:37.014760 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.014761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.014774 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.014828 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:37.015701 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.016244 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.017167 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.017352 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.017402 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.019492 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:37.019494 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:37.019494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:37.019501 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:37.020860 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:37.021230 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:37.021231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:37.021232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:37.021299 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:37.021642 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:37.021644 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:37.021644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:37.021797 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:37.021874 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.022179 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.022269 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 07:20:37.022535 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.013984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:43963 (local address 127.9.142.131:43061)
0811 07:20:37.014156 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:37.014191 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:37.014671 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:37.014876 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:37.014880 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:37.015429 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:37.015623 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.015627 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.016324 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.016324 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.017094 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.017096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.017424 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.017425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.017535 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.018020 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:37.018028 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:37.019402 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:37.020930 (+ 1528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:37.020936 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:37.020938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:37.021151 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:37.021381 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:37.021382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:37.021382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:37.021574 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:37.021872 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:37.021893 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:37.022040 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 07:20:37.022150 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 07:20:37.022298 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":70,"threads_started":1}
I20260811 07:20:37.022921 6986 heartbeater.cc:347] Connected to a master server at 127.9.142.190:43963
I20260811 07:20:37.023015 6986 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:37.023205 6986 heartbeater.cc:511] Master 127.9.142.190:43963 requested a full tablet report, sending...
I20260811 07:20:37.023667 6157 ts_manager.cc:194] Registered new tserver with Master: ddae7d6626a6411896a093fa43adc8f5 (127.9.142.131:37529)
I20260811 07:20:37.024061 6157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:43061
I20260811 07:20:37.033597 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:20:37.040751 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.034908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35480 (local address 127.9.142.190:43963)
0811 07:20:37.034982 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.034984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.035096 (+ 112us) server_negotiation.cc:407] Connection header received
0811 07:20:37.035171 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.035172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.035183 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.035244 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:37.035829 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.036289 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.037047 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.037234 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.037327 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.038405 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:37.038407 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:37.038407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:37.038414 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:37.039499 (+ 1085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:37.039930 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:37.039931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:37.039931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:37.039992 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:37.040202 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:37.040203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:37.040203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:37.040347 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:37.040456 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.040571 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.040651 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 07:20:37.042104 6157 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35480:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:20:37.043663 6157 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:20:37.050410 7012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.046191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:44011 (local address 127.0.0.1:38212)
0811 07:20:37.046336 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:37.046345 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:37.046384 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:37.046855 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:37.046856 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:37.046858 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:37.046928 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.046930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.047973 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.047974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.049141 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.049143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.050102 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.050103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.050184 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.050197 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 07:20:37.050264 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 07:20:37.050318 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":4,"thread_start_us":90,"threads_started":1}
I20260811 07:20:37.050566 7006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.045951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:36423 (local address 127.0.0.1:34712)
0811 07:20:37.046169 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:37.046210 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:37.046276 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:37.046846 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:37.046849 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:37.046852 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:37.046923 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.046925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.048302 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.048303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.049364 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.049366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.050288 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.050289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.050366 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.050375 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 07:20:37.050445 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 07:20:37.050492 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":19,"thread_start_us":78,"threads_started":1}
I20260811 07:20:37.050601 7011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.046101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34712 (local address 127.9.142.129:36423)
0811 07:20:37.046620 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.046624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.046633 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:20:37.046666 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.046668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.046679 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.046841 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:37.047023 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.048181 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.049474 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.050198 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.050267 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.050317 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.050464 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.050504 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":79,"threads_started":1}
I20260811 07:20:37.051079 7025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.046418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38212 (local address 127.9.142.130:44011)
0811 07:20:37.046613 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.046617 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.046626 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:20:37.046667 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.046669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.046686 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.047014 (+ 328us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:37.047093 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.047872 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.049226 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.050001 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.050086 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.050147 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.050938 (+ 791us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.050986 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":89,"threads_started":1}
I20260811 07:20:37.051317 7004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.045993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:37529 (local address 127.0.0.1:37334)
0811 07:20:37.046169 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:37.046210 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:37.046275 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:37.047075 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:37.047077 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:37.047079 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:37.047114 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.047115 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.048380 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.048380 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.050031 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.050032 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.051047 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.051048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.051119 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.051123 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:37.051179 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:20:37.051227 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":106,"threads_started":1}
I20260811 07:20:37.051398 6376 tablet_service.cc:1467] Processing CreateTablet for tablet cd3f183b11e84016b8a464b44985e9d0 (DEFAULT_TABLE table=test-table [id=70adac9e48384b35ab9f7d9a6fb00e9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:37.051858 6376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3f183b11e84016b8a464b44985e9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:37.051952 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.046376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37334 (local address 127.9.142.131:37529)
0811 07:20:37.046586 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.046591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.046602 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:20:37.046642 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.046644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.046660 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.046994 (+ 334us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:37.047201 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.048276 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.050143 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.050893 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.050961 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.051012 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.051825 (+ 813us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.051873 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":112,"threads_started":1}
I20260811 07:20:37.051865 6618 tablet_service.cc:1467] Processing CreateTablet for tablet cd3f183b11e84016b8a464b44985e9d0 (DEFAULT_TABLE table=test-table [id=70adac9e48384b35ab9f7d9a6fb00e9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:37.052188 6618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3f183b11e84016b8a464b44985e9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:37.054638 7030 tablet_bootstrap.cc:492] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: Bootstrap starting.
I20260811 07:20:37.054811 7028 tablet_bootstrap.cc:492] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775: Bootstrap starting.
I20260811 07:20:37.055385 7030 tablet_bootstrap.cc:654] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:37.055372 6868 tablet_service.cc:1467] Processing CreateTablet for tablet cd3f183b11e84016b8a464b44985e9d0 (DEFAULT_TABLE table=test-table [id=70adac9e48384b35ab9f7d9a6fb00e9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:37.055619 7028 tablet_bootstrap.cc:654] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:37.055717 6868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3f183b11e84016b8a464b44985e9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:37.056038 7030 log.cc:824] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:37.056169 7028 log.cc:824] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:37.056881 7030 tablet_bootstrap.cc:492] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: No bootstrap required, opened a new log
I20260811 07:20:37.056944 7030 ts_tablet_manager.cc:1397] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:20:37.057019 7028 tablet_bootstrap.cc:492] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775: No bootstrap required, opened a new log
I20260811 07:20:37.057072 7028 ts_tablet_manager.cc:1397] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 07:20:37.058705 7036 tablet_bootstrap.cc:492] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: Bootstrap starting.
I20260811 07:20:37.059326 7036 tablet_bootstrap.cc:654] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:37.059265 7030 raft_consensus.cc:348] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } }
I20260811 07:20:37.059265 7028 raft_consensus.cc:348] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } }
I20260811 07:20:37.059456 7028 raft_consensus.cc:374] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:37.059458 7030 raft_consensus.cc:374] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:37.059500 7028 raft_consensus.cc:729] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f58f48116dc7423182dbb768390ea775, State: Initialized, Role: FOLLOWER
I20260811 07:20:37.059511 7030 raft_consensus.cc:729] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c370aa8f717411382fd3bf004e6e52c, State: Initialized, Role: FOLLOWER
I20260811 07:20:37.059629 7030 consensus_queue.cc:260] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } }
I20260811 07:20:37.059638 7028 consensus_queue.cc:260] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } }
I20260811 07:20:37.059950 7028 ts_tablet_manager.cc:1428] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:20:37.059958 6741 heartbeater.cc:503] Master 127.9.142.190:43963 was elected leader, sending a full tablet report...
I20260811 07:20:37.060001 7036 log.cc:824] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:37.060086 6497 heartbeater.cc:503] Master 127.9.142.190:43963 was elected leader, sending a full tablet report...
I20260811 07:20:37.059950 7030 ts_tablet_manager.cc:1428] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:20:37.060755 7036 tablet_bootstrap.cc:492] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: No bootstrap required, opened a new log
I20260811 07:20:37.060837 7036 ts_tablet_manager.cc:1397] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:20:37.062618 7036 raft_consensus.cc:348] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } }
I20260811 07:20:37.062806 7036 raft_consensus.cc:374] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:37.062835 7036 raft_consensus.cc:729] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddae7d6626a6411896a093fa43adc8f5, State: Initialized, Role: FOLLOWER
I20260811 07:20:37.062956 7036 consensus_queue.cc:260] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } }
I20260811 07:20:37.063166 7036 ts_tablet_manager.cc:1428] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:20:37.063217 6986 heartbeater.cc:503] Master 127.9.142.190:43963 was elected leader, sending a full tablet report...
W20260811 07:20:37.092550 6745 tablet.cc:2369] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:20:37.172166 6499 tablet.cc:2369] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:20:37.263921 6989 tablet.cc:2369] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:20:37.285356 7042 raft_consensus.cc:482] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:37.285511 7042 raft_consensus.cc:504] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } }
I20260811 07:20:37.285986 7042 leader_election.cc:288] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f58f48116dc7423182dbb768390ea775 (127.9.142.129:36423), 1c370aa8f717411382fd3bf004e6e52c (127.9.142.130:44011)
I20260811 07:20:37.289848 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.286244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:36423 (local address 127.9.142.131:33769)
0811 07:20:37.286311 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:37.286326 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:37.286462 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:37.286715 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:37.286716 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:37.286719 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:37.286851 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.286853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.287793 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.287794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.288830 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.288832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.289510 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.289511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.289615 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.289619 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:37.289672 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 07:20:37.289728 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":97}
I20260811 07:20:37.289882 7025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.286600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:41685 (local address 127.9.142.130:44011)
0811 07:20:37.286666 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.286669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.286796 (+ 127us) server_negotiation.cc:407] Connection header received
0811 07:20:37.286854 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.286855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.286872 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.286935 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:37.287120 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.287632 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.288776 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.289230 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.289512 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.289526 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.289758 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.289811 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 07:20:37.289848 7011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.286336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:33769 (local address 127.9.142.129:36423)
0811 07:20:37.286480 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.286482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.286496 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:20:37.286599 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.286600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.286617 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.286692 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:37.286945 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.287634 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.288943 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.289388 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.289530 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.289545 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.289705 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.289761 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260811 07:20:37.289955 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.286478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:44011 (local address 127.9.142.131:41685)
0811 07:20:37.286694 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:37.286707 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:37.286794 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:37.286938 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:37.286939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:37.286940 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:37.287022 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.287024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.287758 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.287759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.288661 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.288664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.289537 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.289539 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.289635 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.289639 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:37.289737 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 07:20:37.289776 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":120,"threads_started":1}
I20260811 07:20:37.290693 6402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3f183b11e84016b8a464b44985e9d0" candidate_uuid: "ddae7d6626a6411896a093fa43adc8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f58f48116dc7423182dbb768390ea775" is_pre_election: true
I20260811 07:20:37.290763 6646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3f183b11e84016b8a464b44985e9d0" candidate_uuid: "ddae7d6626a6411896a093fa43adc8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c370aa8f717411382fd3bf004e6e52c" is_pre_election: true
I20260811 07:20:37.290895 6402 raft_consensus.cc:2454] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddae7d6626a6411896a093fa43adc8f5 in term 0.
I20260811 07:20:37.290949 6646 raft_consensus.cc:2454] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddae7d6626a6411896a093fa43adc8f5 in term 0.
I20260811 07:20:37.291203 6785 leader_election.cc:302] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddae7d6626a6411896a093fa43adc8f5, f58f48116dc7423182dbb768390ea775; no voters:
I20260811 07:20:37.291360 7042 raft_consensus.cc:2781] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:20:37.291435 7042 raft_consensus.cc:482] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:20:37.291455 7042 raft_consensus.cc:3037] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:37.292272 7042 raft_consensus.cc:504] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } }
I20260811 07:20:37.292397 7042 leader_election.cc:288] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [CANDIDATE]: Term 1 election: Requested vote from peers f58f48116dc7423182dbb768390ea775 (127.9.142.129:36423), 1c370aa8f717411382fd3bf004e6e52c (127.9.142.130:44011)
I20260811 07:20:37.292647 6402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3f183b11e84016b8a464b44985e9d0" candidate_uuid: "ddae7d6626a6411896a093fa43adc8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f58f48116dc7423182dbb768390ea775"
I20260811 07:20:37.292672 6646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd3f183b11e84016b8a464b44985e9d0" candidate_uuid: "ddae7d6626a6411896a093fa43adc8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c370aa8f717411382fd3bf004e6e52c"
I20260811 07:20:37.292732 6402 raft_consensus.cc:3037] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:37.292788 6646 raft_consensus.cc:3037] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:37.293519 6402 raft_consensus.cc:2454] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddae7d6626a6411896a093fa43adc8f5 in term 1.
I20260811 07:20:37.293712 6785 leader_election.cc:302] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddae7d6626a6411896a093fa43adc8f5, f58f48116dc7423182dbb768390ea775; no voters:
I20260811 07:20:37.293790 6646 raft_consensus.cc:2454] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddae7d6626a6411896a093fa43adc8f5 in term 1.
I20260811 07:20:37.293845 7042 raft_consensus.cc:2781] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:37.294056 7042 raft_consensus.cc:686] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 1 LEADER]: Becoming Leader. State: Replica: ddae7d6626a6411896a093fa43adc8f5, State: Running, Role: LEADER
I20260811 07:20:37.294179 7042 consensus_queue.cc:237] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } }
I20260811 07:20:37.295145 6157 catalog_manager.cc:5495] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddae7d6626a6411896a093fa43adc8f5 (127.9.142.131). New cstate: current_term: 1 leader_uuid: "ddae7d6626a6411896a093fa43adc8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddae7d6626a6411896a093fa43adc8f5" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37529 } health_report { overall_health: HEALTHY } } }
I20260811 07:20:37.336580 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.333486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51696 (local address 127.9.142.131:37529)
0811 07:20:37.333574 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.333577 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.333584 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:20:37.333623 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.333624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.333644 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.333707 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:20:37.333915 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.334503 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.335288 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.335660 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.335831 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.336035 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:20:37.336319 (+ 284us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:20:37.336446 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.336464 (+ 18us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.336493 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:20:37.338722 6646 raft_consensus.cc:1261] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [term 1 FOLLOWER]: Refusing update from remote peer ddae7d6626a6411896a093fa43adc8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:37.338765 6402 raft_consensus.cc:1261] T cd3f183b11e84016b8a464b44985e9d0 P f58f48116dc7423182dbb768390ea775 [term 1 FOLLOWER]: Refusing update from remote peer ddae7d6626a6411896a093fa43adc8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:37.339174 7046 consensus_queue.cc:1035] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f58f48116dc7423182dbb768390ea775" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 36423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:37.339329 7042 consensus_queue.cc:1035] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c370aa8f717411382fd3bf004e6e52c" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:37.342239 7058 mvcc.cc:205] Tried to move back new op lower bound from 7317228901736333312 to 7317228901557604352. Current Snapshot: MvccSnapshot[applied={T|T < 7317228901736333312}]
I20260811 07:20:37.344084 6157 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:37.344183 6157 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:37.345332 6157 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 681733fd00b846b4b055a1d9f9d96d5e: Sending DeleteTablet for 3 replicas of tablet cd3f183b11e84016b8a464b44985e9d0
I20260811 07:20:37.345865 6376 tablet_service.cc:1514] Processing DeleteTablet for tablet cd3f183b11e84016b8a464b44985e9d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:37 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:34712
I20260811 07:20:37.345851 6868 tablet_service.cc:1514] Processing DeleteTablet for tablet cd3f183b11e84016b8a464b44985e9d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:37 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:37334
I20260811 07:20:37.345882 6618 tablet_service.cc:1514] Processing DeleteTablet for tablet cd3f183b11e84016b8a464b44985e9d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:37 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:38212
I20260811 07:20:37.346225 7081 tablet_replica.cc:330] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: stopping tablet replica
I20260811 07:20:37.346225 7080 tablet_replica.cc:330] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: stopping tablet replica
I20260811 07:20:37.346341 7080 raft_consensus.cc:2229] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:20:37.346351 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 6254
I20260811 07:20:37.346365 7081 raft_consensus.cc:2229] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:37.356837 7081 raft_consensus.cc:2258] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:37.357900 7080 raft_consensus.cc:2258] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:37.359189 7081 ts_tablet_manager.cc:1905] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:37.360002 7080 ts_tablet_manager.cc:1905] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:37.361243 7081 ts_tablet_manager.cc:1918] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:37.361317 7081 log.cc:1196] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/cd3f183b11e84016b8a464b44985e9d0
I20260811 07:20:37.361578 7081 ts_tablet_manager.cc:1939] T cd3f183b11e84016b8a464b44985e9d0 P 1c370aa8f717411382fd3bf004e6e52c: Deleting consensus metadata
I20260811 07:20:37.361943 7080 ts_tablet_manager.cc:1918] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:37.362015 7080 log.cc:1196] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/cd3f183b11e84016b8a464b44985e9d0
I20260811 07:20:37.362188 6138 catalog_manager.cc:4841] TS 1c370aa8f717411382fd3bf004e6e52c (127.9.142.130:44011): tablet cd3f183b11e84016b8a464b44985e9d0 (table test-table [id=70adac9e48384b35ab9f7d9a6fb00e9b]) successfully deleted
I20260811 07:20:37.362314 7080 ts_tablet_manager.cc:1939] T cd3f183b11e84016b8a464b44985e9d0 P ddae7d6626a6411896a093fa43adc8f5: Deleting consensus metadata
I20260811 07:20:37.362768 6136 catalog_manager.cc:4841] TS ddae7d6626a6411896a093fa43adc8f5 (127.9.142.131:37529): tablet cd3f183b11e84016b8a464b44985e9d0 (table test-table [id=70adac9e48384b35ab9f7d9a6fb00e9b]) successfully deleted
W20260811 07:20:37.375614 6138 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:36423 (error 108)
I20260811 07:20:37.375871 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 6505
I20260811 07:20:37.376230 7004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.376111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:36423 (local address 127.0.0.1:37906)
0811 07:20:37.376160 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:37.376189 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:36423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 07:20:37.376336 6138 catalog_manager.cc:4584] TS f58f48116dc7423182dbb768390ea775 (127.9.142.129:36423): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cd3f183b11e84016b8a464b44985e9d0: Network error: Client connection negotiation failed: client connection to 127.9.142.129:36423: connect: Connection refused (error 111)
I20260811 07:20:37.396167 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 6755
I20260811 07:20:37.408160 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 6104
2026-08-11T07:20:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2587 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T07:20:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:37Z Disabled control of system clock
I20260811 07:20:37.441635 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:36421
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:37189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:36421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:37.523182 7091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:37.523387 7091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:37.523407 7091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:37.524533 7091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:37.524569 7091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:37.524582 7091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:37.524595 7091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:37.524607 7091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:37.525828 7091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:37189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:36421
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:36421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:37.526038 7091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:37.526264 7091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:37.531103 7100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:37.531198 7101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:37.531101 7103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:37.531570 7091 server_base.cc:1034] running on GCE node
I20260811 07:20:37.531905 7091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:37.532222 7091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:37.533417 7091 hybrid_clock.cc:648] HybridClock initialized: now 1786432837533399 us; error 35 us; skew 500 ppm
I20260811 07:20:37.534639 7091 webserver.cc:460] Webserver started at http://127.9.142.190:45695/ using document root <none> and password file <none>
I20260811 07:20:37.534901 7091 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:37.534973 7091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:37.535136 7091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:37.536265 7091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "16d9f31be3f94a9b9d88fb8dfc130780"
format_stamp: "Formatted at 2026-08-11 07:20:37 on dist-test-slave-7f01"
server_key: "39f158cc4791f8cbbc432be70845c64e"
server_key_iv: "43304a8c3c00a320d86e542a9c2ae44b"
server_key_version: "encryptionkey@0"
I20260811 07:20:37.536640 7091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "16d9f31be3f94a9b9d88fb8dfc130780"
format_stamp: "Formatted at 2026-08-11 07:20:37 on dist-test-slave-7f01"
server_key: "39f158cc4791f8cbbc432be70845c64e"
server_key_iv: "43304a8c3c00a320d86e542a9c2ae44b"
server_key_version: "encryptionkey@0"
I20260811 07:20:37.537977 7091 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:20:37.538686 7112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:37.538865 7091 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:20:37.538975 7091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "16d9f31be3f94a9b9d88fb8dfc130780"
format_stamp: "Formatted at 2026-08-11 07:20:37 on dist-test-slave-7f01"
server_key: "39f158cc4791f8cbbc432be70845c64e"
server_key_iv: "43304a8c3c00a320d86e542a9c2ae44b"
server_key_version: "encryptionkey@0"
I20260811 07:20:37.539049 7091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:37.547629 7091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:37.547920 7091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:37.548071 7091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:37.551885 7091 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:36421
I20260811 07:20:37.551915 7199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:36421 every 8 connection(s)
I20260811 07:20:37.552244 7091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:37.553190 7200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:37.555330 7200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780: Bootstrap starting.
I20260811 07:20:37.555915 7200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:37.555910 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 7091
I20260811 07:20:37.556032 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:37.556234 9786 external_mini_cluster.cc:1428] Setting key 13db72e66dbbd2e1966901cd226fec64
I20260811 07:20:37.556257 7200 log.cc:824] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:37.557078 7200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780: No bootstrap required, opened a new log
I20260811 07:20:37.559392 7200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d9f31be3f94a9b9d88fb8dfc130780" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36421 } }
I20260811 07:20:37.559559 7200 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:37.559592 7200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16d9f31be3f94a9b9d88fb8dfc130780, State: Initialized, Role: FOLLOWER
I20260811 07:20:37.559707 7200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d9f31be3f94a9b9d88fb8dfc130780" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36421 } }
I20260811 07:20:37.559811 7200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:37.559908 7200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:37.559971 7200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:37.560623 7200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d9f31be3f94a9b9d88fb8dfc130780" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36421 } }
I20260811 07:20:37.560748 7200 leader_election.cc:302] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16d9f31be3f94a9b9d88fb8dfc130780; no voters:
I20260811 07:20:37.560920 7200 leader_election.cc:288] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:37.560973 7214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:37.561139 7214 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [term 1 LEADER]: Becoming Leader. State: Replica: 16d9f31be3f94a9b9d88fb8dfc130780, State: Running, Role: LEADER
I20260811 07:20:37.561234 7200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:37.561300 7214 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d9f31be3f94a9b9d88fb8dfc130780" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36421 } }
I20260811 07:20:37.561729 7216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16d9f31be3f94a9b9d88fb8dfc130780" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d9f31be3f94a9b9d88fb8dfc130780" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36421 } } }
I20260811 07:20:37.561807 7216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:37.561993 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.556763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57598 (local address 127.9.142.190:36421)
0811 07:20:37.556960 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.556966 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.556997 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:20:37.557428 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.557435 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.557495 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.557604 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:37.557836 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.558680 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.559872 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.560349 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.560448 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.561205 (+ 757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:37.561210 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:37.561210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:37.561412 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:37.561470 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:37.561488 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:37.561533 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.561681 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.561768 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
I20260811 07:20:37.562048 7217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16d9f31be3f94a9b9d88fb8dfc130780. Latest consensus state: current_term: 1 leader_uuid: "16d9f31be3f94a9b9d88fb8dfc130780" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16d9f31be3f94a9b9d88fb8dfc130780" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 36421 } } }
I20260811 07:20:37.562110 7217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:37.562245 7229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:37.562801 7229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:37.564450 7229 catalog_manager.cc:1347] Generated new cluster ID: b2153526a1c84b10a6fde1852f54e6ac
I20260811 07:20:37.564510 7229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:37.576617 7229 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:37.577342 7229 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:37.586154 7229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780: Generated new TSK 0
I20260811 07:20:37.586360 7229 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:37.590991 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:36421
--builtin_ntp_servers=127.9.142.148:37189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:37.687650 7252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:37.687980 7252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:37.688023 7252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:37.689224 7252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:37.689287 7252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:37.689332 7252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:20:37.690688 7252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:37189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:36421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:37.690974 7252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:37.691282 7252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:37.697295 7264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:37.697382 7263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:37.697582 7267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:37.697621 7252 server_base.cc:1034] running on GCE node
I20260811 07:20:37.697950 7252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:37.698194 7252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:37.699349 7252 hybrid_clock.cc:648] HybridClock initialized: now 1786432837699337 us; error 26 us; skew 500 ppm
I20260811 07:20:37.700734 7252 webserver.cc:460] Webserver started at http://127.9.142.129:34083/ using document root <none> and password file <none>
I20260811 07:20:37.701001 7252 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:37.701056 7252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:37.701179 7252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:37.702553 7252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "f2378c0d922244b595fc97485f27f0fa"
format_stamp: "Formatted at 2026-08-11 07:20:37 on dist-test-slave-7f01"
server_key: "30bfc4b8de73ba4c2194204d22ed17f8"
server_key_iv: "86a30c514203c44ef642e6920de3cb6b"
server_key_version: "encryptionkey@0"
I20260811 07:20:37.702989 7252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "f2378c0d922244b595fc97485f27f0fa"
format_stamp: "Formatted at 2026-08-11 07:20:37 on dist-test-slave-7f01"
server_key: "30bfc4b8de73ba4c2194204d22ed17f8"
server_key_iv: "86a30c514203c44ef642e6920de3cb6b"
server_key_version: "encryptionkey@0"
I20260811 07:20:37.704586 7252 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 07:20:37.705422 7280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:37.705629 7252 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:20:37.705720 7252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "f2378c0d922244b595fc97485f27f0fa"
format_stamp: "Formatted at 2026-08-11 07:20:37 on dist-test-slave-7f01"
server_key: "30bfc4b8de73ba4c2194204d22ed17f8"
server_key_iv: "86a30c514203c44ef642e6920de3cb6b"
server_key_version: "encryptionkey@0"
I20260811 07:20:37.705783 7252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:37.730158 7252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:37.730525 7252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:37.730785 7252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:37.731119 7252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:37.731499 7252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:37.731561 7252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:37.731607 7252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:37.731640 7252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:37.738193 7252 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:39531
I20260811 07:20:37.738303 7488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:39531 every 8 connection(s)
I20260811 07:20:37.738651 7252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:20:37.744390 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.739502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:51415 (local address 127.9.142.190:36421)
0811 07:20:37.739564 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.739566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.739891 (+ 325us) server_negotiation.cc:407] Connection header received
0811 07:20:37.740456 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.740458 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.740470 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.740537 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:37.741247 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.741837 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.742894 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.743095 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.743175 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.744092 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:37.744093 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:37.744094 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:37.744098 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:37.744112 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:37.744122 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:37.744186 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.744286 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.744311 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 07:20:37.744634 7491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.739468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36421 (local address 127.9.142.129:51415)
0811 07:20:37.739722 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:37.739796 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:37.740342 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:37.740606 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:37.740610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:37.740625 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:37.741146 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.741151 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.741968 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.741969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.742795 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.742799 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.743198 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.743199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.743333 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.743944 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:20:37.743944 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:37.743973 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:20:37.744002 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:37.744189 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:37.744196 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:37.744199 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:20:37.744286 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 07:20:37.744395 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":107,"threads_started":1}
I20260811 07:20:37.745229 7489 heartbeater.cc:347] Connected to a master server at 127.9.142.190:36421
I20260811 07:20:37.745329 7489 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:37.745520 7489 heartbeater.cc:511] Master 127.9.142.190:36421 requested a full tablet report, sending...
I20260811 07:20:37.746089 7141 ts_manager.cc:194] Registered new tserver with Master: f2378c0d922244b595fc97485f27f0fa (127.9.142.129:39531)
I20260811 07:20:37.746724 7141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.129:51415
I20260811 07:20:37.748260 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 7252
I20260811 07:20:37.748346 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:20:37.748598 9786 external_mini_cluster.cc:1428] Setting key 1a95ee92f45990660bbe0a6708c73dd2
I20260811 07:20:37.749622 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:36421
--builtin_ntp_servers=127.9.142.148:37189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:37.839534 7492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:37.839763 7492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:37.839787 7492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:37.840850 7492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:37.840883 7492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:37.840906 7492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:20:37.842310 7492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:37189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:36421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:37.842525 7492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:37.842808 7492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:37.847774 7504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:37.847816 7502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:37.847846 7506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:37.848038 7492 server_base.cc:1034] running on GCE node
I20260811 07:20:37.848276 7492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:37.848529 7492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:37.849709 7492 hybrid_clock.cc:648] HybridClock initialized: now 1786432837849681 us; error 37 us; skew 500 ppm
I20260811 07:20:37.851006 7492 webserver.cc:460] Webserver started at http://127.9.142.130:38925/ using document root <none> and password file <none>
I20260811 07:20:37.851246 7492 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:37.851327 7492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:37.851487 7492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:37.852658 7492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "9019da1a0eb248f08515608482c59b82"
format_stamp: "Formatted at 2026-08-11 07:20:37 on dist-test-slave-7f01"
server_key: "96419f11ffc74c0e35b5ddfd56b88efc"
server_key_iv: "f4f60b1d11447f9b5873aecc88e9f77c"
server_key_version: "encryptionkey@0"
I20260811 07:20:37.853045 7492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "9019da1a0eb248f08515608482c59b82"
format_stamp: "Formatted at 2026-08-11 07:20:37 on dist-test-slave-7f01"
server_key: "96419f11ffc74c0e35b5ddfd56b88efc"
server_key_iv: "f4f60b1d11447f9b5873aecc88e9f77c"
server_key_version: "encryptionkey@0"
I20260811 07:20:37.854357 7492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 07:20:37.855096 7524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:37.855269 7492 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:20:37.855381 7492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "9019da1a0eb248f08515608482c59b82"
format_stamp: "Formatted at 2026-08-11 07:20:37 on dist-test-slave-7f01"
server_key: "96419f11ffc74c0e35b5ddfd56b88efc"
server_key_iv: "f4f60b1d11447f9b5873aecc88e9f77c"
server_key_version: "encryptionkey@0"
I20260811 07:20:37.855456 7492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:37.888770 7492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:37.889145 7492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:37.889315 7492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:37.889599 7492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:37.890031 7492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:37.890094 7492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:37.890142 7492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:37.890165 7492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:37.896986 7492 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:33069
I20260811 07:20:37.897043 7728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:33069 every 8 connection(s)
I20260811 07:20:37.897440 7492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:20:37.902892 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.898260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:53763 (local address 127.9.142.190:36421)
0811 07:20:37.898309 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:37.898311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:37.898661 (+ 350us) server_negotiation.cc:407] Connection header received
0811 07:20:37.899188 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:37.899189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:37.899206 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:37.899264 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:37.900020 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.900556 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.901550 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.901739 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.901804 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.902670 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:37.902671 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:37.902672 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:37.902676 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:37.902687 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:37.902690 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:37.902733 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:37.902793 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 07:20:37.902815 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:20:37.903059 7732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:37.898248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36421 (local address 127.9.142.130:53763)
0811 07:20:37.898546 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:37.898583 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:37.899080 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:37.899314 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:37.899319 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:37.899327 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:37.899914 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.899920 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.900648 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.900649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.901443 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:37.901446 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:37.901823 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:37.901824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:37.901936 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:37.902538 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:20:37.902538 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:37.902567 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:20:37.902589 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:37.902733 (+ 144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:37.902735 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:37.902737 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:20:37.902782 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 07:20:37.902857 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":121,"threads_started":1}
I20260811 07:20:37.903597 7729 heartbeater.cc:347] Connected to a master server at 127.9.142.190:36421
I20260811 07:20:37.903688 7729 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:37.903892 7729 heartbeater.cc:511] Master 127.9.142.190:36421 requested a full tablet report, sending...
I20260811 07:20:37.904284 7141 ts_manager.cc:194] Registered new tserver with Master: 9019da1a0eb248f08515608482c59b82 (127.9.142.130:33069)
I20260811 07:20:37.904627 7141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.130:53763
I20260811 07:20:37.906440 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 7492
I20260811 07:20:37.906582 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:20:37.906833 9786 external_mini_cluster.cc:1428] Setting key bc6bb53bd5ed66241f9ff7d77c92a4d6
I20260811 07:20:37.907876 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:36421
--builtin_ntp_servers=127.9.142.148:37189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:37.999053 7733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:37.999289 7733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:37.999313 7733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:38.000622 7733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:38.000664 7733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:38.000690 7733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:20:38.002080 7733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:37189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:36421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:38.002367 7733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:38.002701 7733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:38.008095 7754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:38.008116 7750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:38.008174 7733 server_base.cc:1034] running on GCE node
W20260811 07:20:38.008118 7744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:38.008499 7733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:38.008765 7733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:38.010001 7733 hybrid_clock.cc:648] HybridClock initialized: now 1786432838010002 us; error 66 us; skew 500 ppm
I20260811 07:20:38.011409 7733 webserver.cc:460] Webserver started at http://127.9.142.131:46541/ using document root <none> and password file <none>
I20260811 07:20:38.011730 7733 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:38.011893 7733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:38.012009 7733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:38.013142 7733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "6035202f77d84ae194b4ce90da7fae2d"
format_stamp: "Formatted at 2026-08-11 07:20:38 on dist-test-slave-7f01"
server_key: "47c2a6d1f371f47d4991e079c74496a7"
server_key_iv: "d252b45e918ad0447dbacb6ae0eb0352"
server_key_version: "encryptionkey@0"
I20260811 07:20:38.013463 7733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "6035202f77d84ae194b4ce90da7fae2d"
format_stamp: "Formatted at 2026-08-11 07:20:38 on dist-test-slave-7f01"
server_key: "47c2a6d1f371f47d4991e079c74496a7"
server_key_iv: "d252b45e918ad0447dbacb6ae0eb0352"
server_key_version: "encryptionkey@0"
I20260811 07:20:38.014856 7733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:20:38.015627 7767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:38.015873 7733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:38.015960 7733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "6035202f77d84ae194b4ce90da7fae2d"
format_stamp: "Formatted at 2026-08-11 07:20:38 on dist-test-slave-7f01"
server_key: "47c2a6d1f371f47d4991e079c74496a7"
server_key_iv: "d252b45e918ad0447dbacb6ae0eb0352"
server_key_version: "encryptionkey@0"
I20260811 07:20:38.016018 7733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:38.030944 7733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:38.031251 7733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:38.031417 7733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:38.031618 7733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:38.032054 7733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:38.032096 7733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:38.032122 7733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:38.032182 7733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:38.039026 7733 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:33613
I20260811 07:20:38.039111 7978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:33613 every 8 connection(s)
I20260811 07:20:38.039474 7733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:20:38.044651 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 7733
I20260811 07:20:38.044808 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:20:38.045032 9786 external_mini_cluster.cc:1428] Setting key 6de88cfbd95bde5763bbca53ed6ebc8d
I20260811 07:20:38.045789 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.040358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:59757 (local address 127.9.142.190:36421)
0811 07:20:38.040438 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:38.040441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:38.040614 (+ 173us) server_negotiation.cc:407] Connection header received
0811 07:20:38.041226 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:38.041227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:38.041238 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:38.041305 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:38.042140 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.042696 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.043885 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.044155 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.044213 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.045446 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:38.045447 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:38.045448 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:38.045453 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:38.045470 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:38.045475 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:38.045552 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:38.045672 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 07:20:38.045701 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:20:38.046044 7984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.040256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:36421 (local address 127.9.142.131:59757)
0811 07:20:38.040477 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:38.040530 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:38.041111 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:38.041411 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:38.041415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:38.041424 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:38.042050 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.042056 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.042790 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.042791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.043792 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.043796 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.044290 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.044292 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.044511 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.045233 (+ 722us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:20:38.045233 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:38.045266 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:20:38.045293 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:38.045554 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:38.045562 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:38.045566 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:38.045658 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 07:20:38.045775 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":110,"threads_started":1}
I20260811 07:20:38.046535 7979 heartbeater.cc:347] Connected to a master server at 127.9.142.190:36421
I20260811 07:20:38.046631 7979 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:38.046802 7979 heartbeater.cc:511] Master 127.9.142.190:36421 requested a full tablet report, sending...
I20260811 07:20:38.047183 7141 ts_manager.cc:194] Registered new tserver with Master: 6035202f77d84ae194b4ce90da7fae2d (127.9.142.131:33613)
I20260811 07:20:38.047658 7141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.131:59757
I20260811 07:20:38.057215 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:20:38.061981 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.058747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57600 (local address 127.9.142.190:36421)
0811 07:20:38.058817 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:38.058819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:38.058979 (+ 160us) server_negotiation.cc:407] Connection header received
0811 07:20:38.059006 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:38.059007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:38.059017 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:38.059081 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:38.059223 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.059864 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.060608 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.060815 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.060884 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.061647 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:38.061648 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:38.061649 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:38.061653 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:38.061667 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:38.061671 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:38.061722 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:38.061819 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 07:20:38.061845 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:20:38.063927 7141 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:20:38.065630 7141 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:20:38.072824 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.068466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37558 (local address 127.9.142.131:33613)
0811 07:20:38.068653 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:38.068659 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:38.068673 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:20:38.068757 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:38.068759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:38.068777 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:38.068866 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:38.069126 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.070026 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.071629 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.072310 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.072387 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.072483 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:38.072701 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 07:20:38.072739 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":86,"threads_started":1}
I20260811 07:20:38.072836 7996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.068194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:39531 (local address 127.0.0.1:43424)
0811 07:20:38.068397 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:38.068440 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:38.068519 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:38.068939 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:38.068943 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:38.068946 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:38.069021 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.069023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.070526 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.070527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.071396 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.071399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.072422 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.072424 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.072554 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.072572 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 07:20:38.072648 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 07:20:38.072725 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":1,"thread_start_us":84,"threads_started":1}
I20260811 07:20:38.073038 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.068466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52236 (local address 127.9.142.130:33069)
0811 07:20:38.068672 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:38.068676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:38.068686 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:20:38.068940 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:38.068943 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:38.068962 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:38.069055 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:38.069159 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.070431 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.071863 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.072459 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.072540 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.072643 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:38.072886 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 07:20:38.072951 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":97,"threads_started":1}
I20260811 07:20:38.073117 8005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.068295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43424 (local address 127.9.142.129:39531)
0811 07:20:38.068775 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:38.068779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:38.068788 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:20:38.068826 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:38.068828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:38.068843 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:38.068922 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:38.069119 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.070409 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.071501 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.072310 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.072388 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.072483 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:38.072960 (+ 477us) server_negotiation.cc:299] Negotiation successful
0811 07:20:38.073007 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":97,"threads_started":1}
I20260811 07:20:38.073230 7995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.068240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:33069 (local address 127.0.0.1:52236)
0811 07:20:38.068492 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:38.068504 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:38.068783 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:38.069050 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:38.069051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:38.069053 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:38.069090 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.069091 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.070522 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.070524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.071734 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.071736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.072684 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.072685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.072746 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.072749 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:20:38.072803 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 07:20:38.072838 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":61,"thread_start_us":53,"threads_started":1}
I20260811 07:20:38.073812 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.068240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:33613 (local address 127.0.0.1:37558)
0811 07:20:38.068629 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:38.068638 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:38.068679 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:38.068934 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:38.068941 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:38.068943 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:38.069035 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.069037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.070161 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.070162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.071528 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.071531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.072523 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.072524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.072592 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.072598 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:20:38.072652 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 07:20:38.072733 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":41,"thread_start_us":55,"threads_started":1}
I20260811 07:20:38.073922 7364 tablet_service.cc:1467] Processing CreateTablet for tablet 936d522f2d004c9a8c0b5a5d10a5d17a (DEFAULT_TABLE table=test-table [id=ef3168c4ff8b4fe68bfc4b6d7c2bad51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:38.074383 7364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 936d522f2d004c9a8c0b5a5d10a5d17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:38.074638 7861 tablet_service.cc:1467] Processing CreateTablet for tablet 936d522f2d004c9a8c0b5a5d10a5d17a (DEFAULT_TABLE table=test-table [id=ef3168c4ff8b4fe68bfc4b6d7c2bad51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:38.074990 7861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 936d522f2d004c9a8c0b5a5d10a5d17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:38.076251 7623 tablet_service.cc:1467] Processing CreateTablet for tablet 936d522f2d004c9a8c0b5a5d10a5d17a (DEFAULT_TABLE table=test-table [id=ef3168c4ff8b4fe68bfc4b6d7c2bad51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:38.076617 7623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 936d522f2d004c9a8c0b5a5d10a5d17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:38.078388 8010 tablet_bootstrap.cc:492] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa: Bootstrap starting.
I20260811 07:20:38.078595 8011 tablet_bootstrap.cc:492] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: Bootstrap starting.
I20260811 07:20:38.079264 8011 tablet_bootstrap.cc:654] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:38.079408 8010 tablet_bootstrap.cc:654] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:38.079670 8011 log.cc:824] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:38.079851 8010 log.cc:824] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:38.080008 8017 tablet_bootstrap.cc:492] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: Bootstrap starting.
I20260811 07:20:38.080757 8011 tablet_bootstrap.cc:492] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: No bootstrap required, opened a new log
I20260811 07:20:38.080816 8010 tablet_bootstrap.cc:492] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa: No bootstrap required, opened a new log
I20260811 07:20:38.080866 8011 ts_tablet_manager.cc:1397] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:20:38.080885 8010 ts_tablet_manager.cc:1397] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 07:20:38.080907 8017 tablet_bootstrap.cc:654] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:38.081257 8017 log.cc:824] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:38.082290 8017 tablet_bootstrap.cc:492] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: No bootstrap required, opened a new log
I20260811 07:20:38.082365 8017 ts_tablet_manager.cc:1397] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:20:38.083312 8011 raft_consensus.cc:348] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } }
I20260811 07:20:38.083484 8011 raft_consensus.cc:374] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:38.083535 8011 raft_consensus.cc:729] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6035202f77d84ae194b4ce90da7fae2d, State: Initialized, Role: FOLLOWER
I20260811 07:20:38.083679 8011 consensus_queue.cc:260] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } }
I20260811 07:20:38.083880 8010 raft_consensus.cc:348] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } }
I20260811 07:20:38.084023 8010 raft_consensus.cc:374] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:38.084067 8010 raft_consensus.cc:729] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2378c0d922244b595fc97485f27f0fa, State: Initialized, Role: FOLLOWER
I20260811 07:20:38.084049 8011 ts_tablet_manager.cc:1428] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 07:20:38.084190 7979 heartbeater.cc:503] Master 127.9.142.190:36421 was elected leader, sending a full tablet report...
I20260811 07:20:38.084190 8010 consensus_queue.cc:260] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } }
I20260811 07:20:38.084431 8010 ts_tablet_manager.cc:1428] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260811 07:20:38.084555 7489 heartbeater.cc:503] Master 127.9.142.190:36421 was elected leader, sending a full tablet report...
I20260811 07:20:38.085062 8017 raft_consensus.cc:348] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } }
I20260811 07:20:38.085218 8017 raft_consensus.cc:374] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:38.085256 8017 raft_consensus.cc:729] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9019da1a0eb248f08515608482c59b82, State: Initialized, Role: FOLLOWER
I20260811 07:20:38.085363 8017 consensus_queue.cc:260] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } }
I20260811 07:20:38.085623 8017 ts_tablet_manager.cc:1428] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 07:20:38.085757 7729 heartbeater.cc:503] Master 127.9.142.190:36421 was elected leader, sending a full tablet report...
W20260811 07:20:38.148025 7731 tablet.cc:2369] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:20:38.239475 7490 tablet.cc:2369] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:20:38.290174 7980 tablet.cc:2369] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:20:38.320133 8027 raft_consensus.cc:482] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:38.320268 8027 raft_consensus.cc:504] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } }
I20260811 07:20:38.320604 8027 leader_election.cc:288] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6035202f77d84ae194b4ce90da7fae2d (127.9.142.131:33613), 9019da1a0eb248f08515608482c59b82 (127.9.142.130:33069)
I20260811 07:20:38.324668 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.320945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:32983 (local address 127.9.142.130:33069)
0811 07:20:38.320989 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:38.320991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:38.320999 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:20:38.321092 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:38.321093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:38.321106 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:38.321175 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:38.321391 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.322140 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.323712 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.324301 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.324376 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.324385 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:38.324556 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 07:20:38.324594 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:20:38.324668 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.320894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:37357 (local address 127.9.142.131:33613)
0811 07:20:38.320956 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:38.320958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:38.321014 (+ 56us) server_negotiation.cc:407] Connection header received
0811 07:20:38.321093 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:38.321093 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:38.321104 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:38.321175 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:38.321391 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.322139 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.323711 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.324295 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.324377 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.324385 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:38.324556 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 07:20:38.324599 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 07:20:38.324717 8031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.320820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:33613 (local address 127.9.142.129:37357)
0811 07:20:38.320945 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:38.320958 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:38.321016 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:38.321203 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:38.321204 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:38.321206 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:38.321304 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.321307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.322227 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.322228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.323600 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.323605 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.324405 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.324405 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.324469 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.324476 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:20:38.324536 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 07:20:38.324594 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":88,"thread_start_us":66,"threads_started":1}
I20260811 07:20:38.324717 8029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.320804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:33069 (local address 127.9.142.129:32983)
0811 07:20:38.320946 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:38.320958 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:38.321016 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:38.321203 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:38.321204 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:38.321207 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:38.321304 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.321306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.322227 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.322228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.323612 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:38.323613 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.324390 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.324391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:38.324469 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.324477 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:20:38.324536 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 07:20:38.324594 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":136,"thread_start_us":75,"threads_started":1}
I20260811 07:20:38.325135 7904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "936d522f2d004c9a8c0b5a5d10a5d17a" candidate_uuid: "f2378c0d922244b595fc97485f27f0fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6035202f77d84ae194b4ce90da7fae2d" is_pre_election: true
I20260811 07:20:38.325222 7654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "936d522f2d004c9a8c0b5a5d10a5d17a" candidate_uuid: "f2378c0d922244b595fc97485f27f0fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9019da1a0eb248f08515608482c59b82" is_pre_election: true
I20260811 07:20:38.325309 7904 raft_consensus.cc:2454] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2378c0d922244b595fc97485f27f0fa in term 0.
I20260811 07:20:38.325392 7654 raft_consensus.cc:2454] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2378c0d922244b595fc97485f27f0fa in term 0.
I20260811 07:20:38.325582 7287 leader_election.cc:302] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6035202f77d84ae194b4ce90da7fae2d, f2378c0d922244b595fc97485f27f0fa; no voters:
I20260811 07:20:38.325724 8027 raft_consensus.cc:2781] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:20:38.325784 8027 raft_consensus.cc:482] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:20:38.325815 8027 raft_consensus.cc:3037] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:38.326555 8027 raft_consensus.cc:504] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } }
I20260811 07:20:38.326695 8027 leader_election.cc:288] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [CANDIDATE]: Term 1 election: Requested vote from peers 6035202f77d84ae194b4ce90da7fae2d (127.9.142.131:33613), 9019da1a0eb248f08515608482c59b82 (127.9.142.130:33069)
I20260811 07:20:38.326841 7904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "936d522f2d004c9a8c0b5a5d10a5d17a" candidate_uuid: "f2378c0d922244b595fc97485f27f0fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6035202f77d84ae194b4ce90da7fae2d"
I20260811 07:20:38.326884 7654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "936d522f2d004c9a8c0b5a5d10a5d17a" candidate_uuid: "f2378c0d922244b595fc97485f27f0fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9019da1a0eb248f08515608482c59b82"
I20260811 07:20:38.326934 7904 raft_consensus.cc:3037] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:38.326957 7654 raft_consensus.cc:3037] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:38.327919 7654 raft_consensus.cc:2454] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2378c0d922244b595fc97485f27f0fa in term 1.
I20260811 07:20:38.327919 7904 raft_consensus.cc:2454] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2378c0d922244b595fc97485f27f0fa in term 1.
I20260811 07:20:38.328109 7285 leader_election.cc:302] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9019da1a0eb248f08515608482c59b82, f2378c0d922244b595fc97485f27f0fa; no voters:
I20260811 07:20:38.328233 8027 raft_consensus.cc:2781] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:38.328387 8027 raft_consensus.cc:686] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 1 LEADER]: Becoming Leader. State: Replica: f2378c0d922244b595fc97485f27f0fa, State: Running, Role: LEADER
I20260811 07:20:38.328490 8027 consensus_queue.cc:237] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } }
I20260811 07:20:38.329373 7140 catalog_manager.cc:5495] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa reported cstate change: term changed from 0 to 1, leader changed from <none> to f2378c0d922244b595fc97485f27f0fa (127.9.142.129). New cstate: current_term: 1 leader_uuid: "f2378c0d922244b595fc97485f27f0fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2378c0d922244b595fc97485f27f0fa" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 39531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 } health_report { overall_health: UNKNOWN } } }
I20260811 07:20:38.358135 8005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.355686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43434 (local address 127.9.142.129:39531)
0811 07:20:38.355790 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:38.355793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:38.355802 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:20:38.355852 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:38.355853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:38.355874 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:38.355941 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:20:38.356099 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.356568 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.357291 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:38.357507 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:38.357562 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:38.357778 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:20:38.357888 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:20:38.357947 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:38.358031 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 07:20:38.358057 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:20:38.360103 7904 raft_consensus.cc:1261] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [term 1 FOLLOWER]: Refusing update from remote peer f2378c0d922244b595fc97485f27f0fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:38.360105 7654 raft_consensus.cc:1261] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [term 1 FOLLOWER]: Refusing update from remote peer f2378c0d922244b595fc97485f27f0fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:38.360446 8027 consensus_queue.cc:1035] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6035202f77d84ae194b4ce90da7fae2d" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:38.360607 8033 consensus_queue.cc:1035] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9019da1a0eb248f08515608482c59b82" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 33069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:38.363170 8040 mvcc.cc:205] Tried to move back new op lower bound from 7317228905920061440 to 7317228905794170880. Current Snapshot: MvccSnapshot[applied={T|T < 7317228905920061440}]
I20260811 07:20:38.364233 8038 mvcc.cc:205] Tried to move back new op lower bound from 7317228905920061440 to 7317228905794170880. Current Snapshot: MvccSnapshot[applied={T|T < 7317228905920061440 or (T in {7317228905920061440})}]
I20260811 07:20:38.364380 8039 mvcc.cc:205] Tried to move back new op lower bound from 7317228905920061440 to 7317228905794170880. Current Snapshot: MvccSnapshot[applied={T|T < 7317228905920061440 or (T in {7317228905920061440})}]
I20260811 07:20:38.365684 7141 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:38.365792 7141 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:38.366605 7141 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16d9f31be3f94a9b9d88fb8dfc130780: Sending DeleteTablet for 3 replicas of tablet 936d522f2d004c9a8c0b5a5d10a5d17a
I20260811 07:20:38.366991 7364 tablet_service.cc:1514] Processing DeleteTablet for tablet 936d522f2d004c9a8c0b5a5d10a5d17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:38 UTC) from {username='slave'} at 127.0.0.1:43424
I20260811 07:20:38.367023 7861 tablet_service.cc:1514] Processing DeleteTablet for tablet 936d522f2d004c9a8c0b5a5d10a5d17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:38 UTC) from {username='slave'} at 127.0.0.1:37558
I20260811 07:20:38.367193 7623 tablet_service.cc:1514] Processing DeleteTablet for tablet 936d522f2d004c9a8c0b5a5d10a5d17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:38 UTC) from {username='slave'} at 127.0.0.1:52236
I20260811 07:20:38.367272 8062 tablet_replica.cc:330] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: stopping tablet replica
I20260811 07:20:38.367440 8066 tablet_replica.cc:330] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: stopping tablet replica
I20260811 07:20:38.367517 8061 tablet_replica.cc:330] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa: stopping tablet replica
I20260811 07:20:38.367602 8066 raft_consensus.cc:2229] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:38.367689 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 7252
I20260811 07:20:38.367687 8061 raft_consensus.cc:2229] T 936d522f2d004c9a8c0b5a5d10a5d17a P f2378c0d922244b595fc97485f27f0fa [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:20:38.378831 8062 raft_consensus.cc:2229] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:38.379072 8062 raft_consensus.cc:2258] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:38.367807 8066 raft_consensus.cc:2258] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:38.379658 8062 ts_tablet_manager.cc:1905] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:38.379676 8066 ts_tablet_manager.cc:1905] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:38.381287 8062 ts_tablet_manager.cc:1918] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:38.381393 8062 log.cc:1196] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/936d522f2d004c9a8c0b5a5d10a5d17a
I20260811 07:20:38.381651 8062 ts_tablet_manager.cc:1939] T 936d522f2d004c9a8c0b5a5d10a5d17a P 6035202f77d84ae194b4ce90da7fae2d: Deleting consensus metadata
I20260811 07:20:38.381856 8066 ts_tablet_manager.cc:1918] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:38.381951 8066 log.cc:1196] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/936d522f2d004c9a8c0b5a5d10a5d17a
I20260811 07:20:38.382220 8066 ts_tablet_manager.cc:1939] T 936d522f2d004c9a8c0b5a5d10a5d17a P 9019da1a0eb248f08515608482c59b82: Deleting consensus metadata
I20260811 07:20:38.382268 7118 catalog_manager.cc:4841] TS 6035202f77d84ae194b4ce90da7fae2d (127.9.142.131:33613): tablet 936d522f2d004c9a8c0b5a5d10a5d17a (table test-table [id=ef3168c4ff8b4fe68bfc4b6d7c2bad51]) successfully deleted
I20260811 07:20:38.382690 7116 catalog_manager.cc:4841] TS 9019da1a0eb248f08515608482c59b82 (127.9.142.130:33069): tablet 936d522f2d004c9a8c0b5a5d10a5d17a (table test-table [id=ef3168c4ff8b4fe68bfc4b6d7c2bad51]) successfully deleted
W20260811 07:20:38.385107 7113 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:39531 (error 108)
I20260811 07:20:38.385316 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 7492
I20260811 07:20:38.391650 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:38.390608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:39531 (local address 127.0.0.1:43436)
0811 07:20:38.391556 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:38.391612 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:39531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":923}
W20260811 07:20:38.391906 7113 catalog_manager.cc:4584] TS f2378c0d922244b595fc97485f27f0fa (127.9.142.129:39531): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 936d522f2d004c9a8c0b5a5d10a5d17a: Network error: Client connection negotiation failed: client connection to 127.9.142.129:39531: connect: Connection refused (error 111)
I20260811 07:20:38.404013 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 7733
I20260811 07:20:38.419268 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 7091
2026-08-11T07:20:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1010 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:38 dist-test-slave-7f01 krb5kdc[8073](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:38 dist-test-slave-7f01 krb5kdc[8073](info): set up 2 sockets
Aug 11 07:20:38 dist-test-slave-7f01 krb5kdc[8073](info): commencing operation
krb5kdc: starting...
W20260811 07:20:39.712260 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:39 dist-test-slave-7f01 krb5kdc[8073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:20:39.848213 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:40421
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:42089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:40421
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:39.941255 8100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:39.941476 8100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:39.941498 8100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:39.942652 8100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:39.942696 8100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:39.942711 8100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:39.942724 8100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:39.942761 8100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:39.944276 8100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:42089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:40421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:40421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:39.944532 8100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:39.944783 8100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:39.949805 8114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:39.949857 8107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:39.949769 8106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:39.950111 8100 server_base.cc:1034] running on GCE node
I20260811 07:20:39.950587 8100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:39.950862 8100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:39.952008 8100 hybrid_clock.cc:648] HybridClock initialized: now 1786432839951991 us; error 31 us; skew 500 ppm
Aug 11 07:20:39 dist-test-slave-7f01 krb5kdc[8073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432839, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:39.958868 8100 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:20:39.959439 8100 webserver.cc:460] Webserver started at http://127.9.142.190:34429/ using document root <none> and password file <none>
I20260811 07:20:39.959699 8100 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:39.959810 8100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:39.959991 8100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:39.961155 8100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "2e2415dfd249491994c30d40dd0842dd"
format_stamp: "Formatted at 2026-08-11 07:20:39 on dist-test-slave-7f01"
server_key: "a31e80aadd7b61cb08986f58d6f24db7"
server_key_iv: "c12c6e3fb7f01cf11580d20984e97130"
server_key_version: "encryptionkey@0"
I20260811 07:20:39.961580 8100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "2e2415dfd249491994c30d40dd0842dd"
format_stamp: "Formatted at 2026-08-11 07:20:39 on dist-test-slave-7f01"
server_key: "a31e80aadd7b61cb08986f58d6f24db7"
server_key_iv: "c12c6e3fb7f01cf11580d20984e97130"
server_key_version: "encryptionkey@0"
I20260811 07:20:39.963413 8100 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 07:20:39.964349 8133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:39.964624 8100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:20:39.964746 8100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "2e2415dfd249491994c30d40dd0842dd"
format_stamp: "Formatted at 2026-08-11 07:20:39 on dist-test-slave-7f01"
server_key: "a31e80aadd7b61cb08986f58d6f24db7"
server_key_iv: "c12c6e3fb7f01cf11580d20984e97130"
server_key_version: "encryptionkey@0"
I20260811 07:20:39.964852 8100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:39.989244 8100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:39.991582 8100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:39.991809 8100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:39.997212 8100 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:40421
I20260811 07:20:39.997241 8223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:40421 every 8 connection(s)
I20260811 07:20:39.997810 8100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:39.998822 8224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:40.001789 8224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd: Bootstrap starting.
I20260811 07:20:40.002559 8224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:40.002919 8224 log.cc:824] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:40.003819 8224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd: No bootstrap required, opened a new log
I20260811 07:20:40.004693 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 8100
I20260811 07:20:40.004806 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:40.005017 9786 external_mini_cluster.cc:1428] Setting key 8934aa80f7514be122b24572fcd8679d
I20260811 07:20:40.005990 8224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2415dfd249491994c30d40dd0842dd" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40421 } }
I20260811 07:20:40.006151 8224 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:40.006215 8224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2415dfd249491994c30d40dd0842dd, State: Initialized, Role: FOLLOWER
I20260811 07:20:40.006351 8224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2415dfd249491994c30d40dd0842dd" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40421 } }
I20260811 07:20:40.006462 8224 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:40.006510 8224 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:40.006560 8224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:40.007416 8224 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2415dfd249491994c30d40dd0842dd" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40421 } }
I20260811 07:20:40.007544 8224 leader_election.cc:302] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e2415dfd249491994c30d40dd0842dd; no voters:
I20260811 07:20:40.007707 8224 leader_election.cc:288] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:40.007752 8233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:40.007865 8233 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [term 1 LEADER]: Becoming Leader. State: Replica: 2e2415dfd249491994c30d40dd0842dd, State: Running, Role: LEADER
I20260811 07:20:40.007997 8224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:40.007995 8233 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2415dfd249491994c30d40dd0842dd" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40421 } }
I20260811 07:20:40.008836 8237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e2415dfd249491994c30d40dd0842dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2415dfd249491994c30d40dd0842dd" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40421 } } }
I20260811 07:20:40.009011 8237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:40.008822 8233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e2415dfd249491994c30d40dd0842dd. Latest consensus state: current_term: 1 leader_uuid: "2e2415dfd249491994c30d40dd0842dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2415dfd249491994c30d40dd0842dd" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 40421 } } }
I20260811 07:20:40.009231 8257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:40.009294 8233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:40.009822 8257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 07:20:40 dist-test-slave-7f01 krb5kdc[8073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:40.012409 8257 catalog_manager.cc:1347] Generated new cluster ID: 07a62656479e43e3865fc52471ef2c91
I20260811 07:20:40.012466 8257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:40.016321 8232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.005564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46272 (local address 127.9.142.190:40421)
0811 07:20:40.005787 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.005795 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.005824 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:20:40.005950 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.005956 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.005997 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.006135 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:40.006932 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.007935 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.008859 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.009537 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.009651 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.012677 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:40.012681 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:40.012681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:40.012691 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:40.014620 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.015059 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.015061 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.015062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.015188 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.015424 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.015425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.015425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.015700 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:40.015881 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.016010 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.016137 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":106,"threads_started":1}
I20260811 07:20:40.029223 8257 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:40.029699 8257 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:40.038182 8257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd: Generated new TSK 0
I20260811 07:20:40.038367 8257 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:20:40.071522 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40421
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:42089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:40.155095 8288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:40.155325 8288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:40.155362 8288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:40.156482 8288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:40.156564 8288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:40.156610 8288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:20:40.158103 8288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:42089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:40.158375 8288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:40.158594 8288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:40.163587 8301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:40.163671 8303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:40.163614 8298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:40.163858 8288 server_base.cc:1034] running on GCE node
I20260811 07:20:40.164085 8288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:40.164332 8288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:40.165514 8288 hybrid_clock.cc:648] HybridClock initialized: now 1786432840165503 us; error 30 us; skew 500 ppm
Aug 11 07:20:40 dist-test-slave-7f01 krb5kdc[8073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432840, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:40.168365 8288 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:20:40.168856 8288 webserver.cc:460] Webserver started at http://127.9.142.129:42479/ using document root <none> and password file <none>
I20260811 07:20:40.169103 8288 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:40.169173 8288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:40.169332 8288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:40.170372 8288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "b78ab271ba4847328c2af72f41f3e4b2"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "674a2b91b0e7ae57f4d7dbabbf417c6d"
server_key_iv: "44831a39b7c0cbf9d2faebb146f5656c"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.170744 8288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "b78ab271ba4847328c2af72f41f3e4b2"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "674a2b91b0e7ae57f4d7dbabbf417c6d"
server_key_iv: "44831a39b7c0cbf9d2faebb146f5656c"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.172183 8288 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:20:40.173033 8318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.173238 8288 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:40.173360 8288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "b78ab271ba4847328c2af72f41f3e4b2"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "674a2b91b0e7ae57f4d7dbabbf417c6d"
server_key_iv: "44831a39b7c0cbf9d2faebb146f5656c"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.173439 8288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:40.194541 8288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:40.197064 8288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:40.197244 8288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:40.197520 8288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:40.197860 8288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:40.197919 8288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.197962 8288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:40.198005 8288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.204141 8288 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:44019
I20260811 07:20:40.204205 8537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:44019 every 8 connection(s)
I20260811 07:20:40.204532 8288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:20:40.206935 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 8288
I20260811 07:20:40.207029 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:20:40.207257 9786 external_mini_cluster.cc:1428] Setting key 4d6001bb9acd847ddefdf181956b5647
Aug 11 07:20:40 dist-test-slave-7f01 krb5kdc[8073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432840, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:40.215058 8232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.205286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:47671 (local address 127.9.142.190:40421)
0811 07:20:40.205424 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.205427 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.205609 (+ 182us) server_negotiation.cc:407] Connection header received
0811 07:20:40.206173 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.206174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.206188 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.206248 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:40.207361 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.208104 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.209220 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.209449 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.209537 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.212151 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:40.212153 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:40.212153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:40.212162 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:40.213614 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.214039 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.214040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.214040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.214105 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.214383 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.214384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.214384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.214503 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:40.214577 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.214870 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.214966 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 07:20:40.215257 8541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.205253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:40421 (local address 127.9.142.129:47671)
0811 07:20:40.205470 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:40.205515 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:40.206058 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:40.206337 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:40.206341 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:40.206959 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:40.207237 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.207243 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.208188 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.208190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.209125 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.209128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.209550 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.209552 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.209714 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.210285 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:40.210297 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:40.212051 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:40.213705 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:40.213712 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:40.213714 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:40.213959 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:40.214175 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:40.214176 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:40.214176 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:40.214306 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:40.214583 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:40.214591 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:40.214729 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 07:20:40.214847 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 07:20:40.215007 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":86,"threads_started":1}
I20260811 07:20:40.215793 8539 heartbeater.cc:347] Connected to a master server at 127.9.142.190:40421
I20260811 07:20:40.215910 8539 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:40.216126 8539 heartbeater.cc:511] Master 127.9.142.190:40421 requested a full tablet report, sending...
I20260811 07:20:40.216679 8155 ts_manager.cc:194] Registered new tserver with Master: b78ab271ba4847328c2af72f41f3e4b2 (127.9.142.129:44019)
I20260811 07:20:40.217336 8155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:47671
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:20:40.237023 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40421
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:42089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:40.321133 8548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:40.321323 8548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:40.321354 8548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:40.322396 8548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:40.322431 8548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:40.322458 8548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:20:40.323854 8548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:42089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:40.324038 8548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:40.324215 8548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:40.329422 8558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:40.329421 8561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:40.329504 8559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:40.329922 8548 server_base.cc:1034] running on GCE node
I20260811 07:20:40.330155 8548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:40.330379 8548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:40.331522 8548 hybrid_clock.cc:648] HybridClock initialized: now 1786432840331510 us; error 28 us; skew 500 ppm
Aug 11 07:20:40 dist-test-slave-7f01 krb5kdc[8073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432840, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:40.334254 8548 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:20:40.334764 8548 webserver.cc:460] Webserver started at http://127.9.142.130:44841/ using document root <none> and password file <none>
I20260811 07:20:40.335021 8548 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:40.335091 8548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:40.335242 8548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:40.336378 8548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "f1e7c2963213450f9e2d84c178a32434"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "d4519050e76d7b2a4ca5477797ce06cc"
server_key_iv: "dd58c158d90063d37f387cfe7d00c724"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.336763 8548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "f1e7c2963213450f9e2d84c178a32434"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "d4519050e76d7b2a4ca5477797ce06cc"
server_key_iv: "dd58c158d90063d37f387cfe7d00c724"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.338143 8548 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 07:20:40.338955 8569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.339178 8548 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:40.339291 8548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "f1e7c2963213450f9e2d84c178a32434"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "d4519050e76d7b2a4ca5477797ce06cc"
server_key_iv: "dd58c158d90063d37f387cfe7d00c724"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.339370 8548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:40.349903 8548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:40.352353 8548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:40.352524 8548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:40.352770 8548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:40.353096 8548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:40.353152 8548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.353194 8548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:40.353220 8548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.359654 8548 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:42891
I20260811 07:20:40.359711 8783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:42891 every 8 connection(s)
I20260811 07:20:40.360113 8548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:20:40.362807 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 8548
I20260811 07:20:40.362926 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:20:40.363155 9786 external_mini_cluster.cc:1428] Setting key fe7bba7acd475100668f6d5dbde42ce6
Aug 11 07:20:40 dist-test-slave-7f01 krb5kdc[8073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432840, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:40.371119 8232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.360892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:59055 (local address 127.9.142.190:40421)
0811 07:20:40.361007 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.361010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.361137 (+ 127us) server_negotiation.cc:407] Connection header received
0811 07:20:40.361645 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.361646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.361656 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.361708 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:40.362645 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.363413 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.364864 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.365080 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.365146 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.367788 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:40.367790 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:40.367790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:40.367799 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:40.369551 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.369960 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.369961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.369962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.370035 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.370351 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.370352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.370352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.370521 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:40.370602 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.370874 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.370976 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:20:40.371140 8787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.360838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:40421 (local address 127.9.142.130:59055)
0811 07:20:40.361007 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:40.361045 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:40.361563 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:40.361760 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:40.361764 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:40.362333 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:40.362535 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.362540 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.363498 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.363499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.364759 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.364763 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.365174 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.365175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.365322 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.365856 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:40.365868 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:40.367672 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:40.369650 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:40.369657 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:40.369659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:40.369881 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:40.370129 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:40.370130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:40.370131 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:40.370260 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:40.370603 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:40.370609 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:40.370732 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 07:20:40.370823 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 07:20:40.370966 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
I20260811 07:20:40.371693 8784 heartbeater.cc:347] Connected to a master server at 127.9.142.190:40421
I20260811 07:20:40.371831 8784 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:40.372058 8784 heartbeater.cc:511] Master 127.9.142.190:40421 requested a full tablet report, sending...
I20260811 07:20:40.372519 8155 ts_manager.cc:194] Registered new tserver with Master: f1e7c2963213450f9e2d84c178a32434 (127.9.142.130:42891)
I20260811 07:20:40.372920 8155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:59055
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:20:40.395709 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40421
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:42089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:40.483808 8792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:40.484062 8792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:40.484091 8792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:40.485334 8792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:40.485391 8792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:40.485420 8792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:20:40.487000 8792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:42089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:40421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:40.487299 8792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:40.487574 8792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:40.493058 8802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:40.493265 8803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:40.493079 8810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:40.493372 8792 server_base.cc:1034] running on GCE node
I20260811 07:20:40.493683 8792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:40.494047 8792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:40.495272 8792 hybrid_clock.cc:648] HybridClock initialized: now 1786432840495207 us; error 85 us; skew 500 ppm
Aug 11 07:20:40 dist-test-slave-7f01 krb5kdc[8073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432840, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:40.498423 8792 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:20:40.499027 8792 webserver.cc:460] Webserver started at http://127.9.142.131:42815/ using document root <none> and password file <none>
I20260811 07:20:40.499322 8792 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:40.499402 8792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:40.499575 8792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:40.500910 8792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "180c7808cbca4fb880e8e26e369ca19f"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "98ecf2a0aa930eb976760a47c4dfed21"
server_key_iv: "93a11e6727fb6e7d8ff606ddfa4d6ea2"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.501344 8792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "180c7808cbca4fb880e8e26e369ca19f"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "98ecf2a0aa930eb976760a47c4dfed21"
server_key_iv: "93a11e6727fb6e7d8ff606ddfa4d6ea2"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.503475 8792 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260811 07:20:40.504503 8820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.504689 8792 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:20:40.504810 8792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "180c7808cbca4fb880e8e26e369ca19f"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "98ecf2a0aa930eb976760a47c4dfed21"
server_key_iv: "93a11e6727fb6e7d8ff606ddfa4d6ea2"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.504915 8792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:40.524331 8792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:40.526580 8792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:40.526784 8792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:40.527062 8792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:40.527405 8792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:40.527463 8792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.527508 8792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:40.527534 8792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.534137 8792 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:37743
I20260811 07:20:40.534258 9042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:37743 every 8 connection(s)
I20260811 07:20:40.534565 8792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
Aug 11 07:20:40 dist-test-slave-7f01 krb5kdc[8073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432840, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:40.543946 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 8792
I20260811 07:20:40.544075 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:20:40.544198 8232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.535395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:52139 (local address 127.9.142.190:40421)
0811 07:20:40.535444 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.535446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.535653 (+ 207us) server_negotiation.cc:407] Connection header received
0811 07:20:40.536219 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.536221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.536234 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.536299 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:40.537286 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.537807 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.538908 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.539114 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.539203 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.541393 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:40.541395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:40.541395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:40.541403 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:40.542755 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.543158 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.543159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.543160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.543222 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.543507 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.543508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.543509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.543626 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:40.543700 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.544023 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.544107 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:20:40.544363 9786 external_mini_cluster.cc:1428] Setting key b2c6d88a80b924935c5c206deef5c70b
I20260811 07:20:40.544425 9045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.535355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:40421 (local address 127.9.142.131:52139)
0811 07:20:40.535518 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:40.535561 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:40.536108 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:40.536371 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:40.536375 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:40.536982 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:40.537180 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.537185 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.537907 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.537909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.538809 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.538813 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.539218 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.539219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.539347 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.539925 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:40.539934 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:40.541284 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:40.542842 (+ 1558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:40.542849 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:40.542851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:40.543078 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:40.543291 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:40.543292 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:40.543292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:40.543421 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:40.543722 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:40.543729 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:40.543888 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 07:20:40.543997 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 07:20:40.544160 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260811 07:20:40.544929 9043 heartbeater.cc:347] Connected to a master server at 127.9.142.190:40421
I20260811 07:20:40.545044 9043 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:40.545244 9043 heartbeater.cc:511] Master 127.9.142.190:40421 requested a full tablet report, sending...
I20260811 07:20:40.545699 8155 ts_manager.cc:194] Registered new tserver with Master: 180c7808cbca4fb880e8e26e369ca19f (127.9.142.131:37743)
I20260811 07:20:40.546043 8155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:52139
I20260811 07:20:40.556577 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:20:40.564860 8232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.558046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46274 (local address 127.9.142.190:40421)
0811 07:20:40.558144 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.558147 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.558206 (+ 59us) server_negotiation.cc:407] Connection header received
0811 07:20:40.558247 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.558248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.558257 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.558306 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:40.559075 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.559585 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.560574 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.560762 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.560823 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.562253 (+ 1430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:40.562254 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:40.562254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:40.562261 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:40.563534 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.564039 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.564040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.564040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.564100 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:40.564331 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:40.564332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:40.564332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:40.564469 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:40.564550 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.564674 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.564727 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:20:40.566962 8155 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46274:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:20:40.568820 8155 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:20:40.575449 9064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.571550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42891 (local address 127.0.0.1:59720)
0811 07:20:40.571756 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:40.571799 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:40.571875 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:40.572180 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:40.572183 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:40.572186 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:40.572291 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.572294 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.573369 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.573370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.574245 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.574248 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.575080 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.575081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.575187 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.575206 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 07:20:40.575310 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 07:20:40.575367 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":63,"threads_started":1}
I20260811 07:20:40.575863 9067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.571673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59720 (local address 127.9.142.130:42891)
0811 07:20:40.571904 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.571909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.571922 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:20:40.571970 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.571972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.571989 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.572078 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:40.572361 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.573261 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.574348 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.574987 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.575081 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.575145 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.575341 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.575391 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
I20260811 07:20:40.576399 9069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.571580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:37743 (local address 127.0.0.1:50230)
0811 07:20:40.572062 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:40.572073 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:40.572122 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:40.572471 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:40.572471 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:40.572474 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:40.572514 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.572517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.573936 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.573937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.575188 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.575192 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.576116 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.576117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.576182 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.576186 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:40.576280 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 07:20:40.576329 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":1,"thread_start_us":96,"threads_started":1}
I20260811 07:20:40.576411 9071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.571883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50230 (local address 127.9.142.131:37743)
0811 07:20:40.572109 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.572113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.572123 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:20:40.572301 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.572304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.572319 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.572389 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:40.572628 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.573808 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.575315 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.576024 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.576115 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.576167 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.576279 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.576323 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":103,"threads_started":1}
I20260811 07:20:40.576748 8672 tablet_service.cc:1467] Processing CreateTablet for tablet 9de6a01829ca40e183d430cae577366a (DEFAULT_TABLE table=test-table [id=2bee22b534b44ea4989bebd856b56670]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:40.577032 8919 tablet_service.cc:1467] Processing CreateTablet for tablet 9de6a01829ca40e183d430cae577366a (DEFAULT_TABLE table=test-table [id=2bee22b534b44ea4989bebd856b56670]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:40.577188 8672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de6a01829ca40e183d430cae577366a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:40.577292 8919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de6a01829ca40e183d430cae577366a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:40.579888 9074 tablet_bootstrap.cc:492] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: Bootstrap starting.
I20260811 07:20:40.580170 9075 tablet_bootstrap.cc:492] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: Bootstrap starting.
I20260811 07:20:40.580744 9074 tablet_bootstrap.cc:654] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:40.580793 9075 tablet_bootstrap.cc:654] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:40.580827 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.571776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:44019 (local address 127.0.0.1:44152)
0811 07:20:40.572473 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:40.572484 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:40.572528 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:40.572834 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:40.572835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:40.572837 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:40.572873 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.572874 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.574331 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.574333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.575632 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.575636 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.580562 (+ 4926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.580564 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.580630 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.580635 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:20:40.580693 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 07:20:40.580745 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":117,"threads_started":1}
I20260811 07:20:40.580848 9073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.572050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44152 (local address 127.9.142.129:44019)
0811 07:20:40.572661 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.572667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.572678 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:20:40.572719 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.572721 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.572737 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.572826 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:40.572927 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.574192 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.575757 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.580464 (+ 4707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.580561 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.580625 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.580720 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.580764 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":87,"threads_started":1}
I20260811 07:20:40.581439 9075 log.cc:824] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:40.581439 9074 log.cc:824] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:40.581845 8414 tablet_service.cc:1467] Processing CreateTablet for tablet 9de6a01829ca40e183d430cae577366a (DEFAULT_TABLE table=test-table [id=2bee22b534b44ea4989bebd856b56670]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:40.582199 8414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de6a01829ca40e183d430cae577366a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:40.582291 9075 tablet_bootstrap.cc:492] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: No bootstrap required, opened a new log
I20260811 07:20:40.582379 9075 ts_tablet_manager.cc:1397] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:20:40.583959 9075 raft_consensus.cc:348] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } }
I20260811 07:20:40.584162 9075 raft_consensus.cc:374] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:40.584196 9074 tablet_bootstrap.cc:492] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: No bootstrap required, opened a new log
I20260811 07:20:40.584206 9075 raft_consensus.cc:729] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e7c2963213450f9e2d84c178a32434, State: Initialized, Role: FOLLOWER
I20260811 07:20:40.584257 9074 ts_tablet_manager.cc:1397] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 07:20:40.584379 9075 consensus_queue.cc:260] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } }
I20260811 07:20:40.584707 9075 ts_tablet_manager.cc:1428] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 07:20:40.584765 8784 heartbeater.cc:503] Master 127.9.142.190:40421 was elected leader, sending a full tablet report...
I20260811 07:20:40.587697 9085 tablet_bootstrap.cc:492] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2: Bootstrap starting.
I20260811 07:20:40.588472 9085 tablet_bootstrap.cc:654] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:40.589042 9074 raft_consensus.cc:348] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } }
I20260811 07:20:40.589231 9085 log.cc:824] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:40.589270 9074 raft_consensus.cc:374] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:40.589316 9074 raft_consensus.cc:729] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 180c7808cbca4fb880e8e26e369ca19f, State: Initialized, Role: FOLLOWER
I20260811 07:20:40.589464 9074 consensus_queue.cc:260] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } }
I20260811 07:20:40.589826 9074 ts_tablet_manager.cc:1428] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:20:40.589874 9043 heartbeater.cc:503] Master 127.9.142.190:40421 was elected leader, sending a full tablet report...
I20260811 07:20:40.592718 9085 tablet_bootstrap.cc:492] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2: No bootstrap required, opened a new log
I20260811 07:20:40.592796 9085 ts_tablet_manager.cc:1397] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 07:20:40.595218 9085 raft_consensus.cc:348] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } }
I20260811 07:20:40.595501 9085 raft_consensus.cc:374] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:40.595561 9085 raft_consensus.cc:729] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b78ab271ba4847328c2af72f41f3e4b2, State: Initialized, Role: FOLLOWER
I20260811 07:20:40.595773 9085 consensus_queue.cc:260] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } }
I20260811 07:20:40.597139 8539 heartbeater.cc:503] Master 127.9.142.190:40421 was elected leader, sending a full tablet report...
I20260811 07:20:40.597177 9085 ts_tablet_manager.cc:1428] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
W20260811 07:20:40.610800 8785 tablet.cc:2369] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:20:40.705339 8540 tablet.cc:2369] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:20:40.727437 9088 raft_consensus.cc:482] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:40.727583 9088 raft_consensus.cc:504] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } }
I20260811 07:20:40.728085 9088 leader_election.cc:288] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1e7c2963213450f9e2d84c178a32434 (127.9.142.130:42891), 180c7808cbca4fb880e8e26e369ca19f (127.9.142.131:37743)
I20260811 07:20:40.731339 9071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.728440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:55823 (local address 127.9.142.131:37743)
0811 07:20:40.728497 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.728500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.728562 (+ 62us) server_negotiation.cc:407] Connection header received
0811 07:20:40.728689 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.728690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.728700 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.728780 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:40.728971 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.729483 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.730590 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.730956 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.731016 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.731023 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.731215 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.731260 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 07:20:40.731387 9067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.728440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:51745 (local address 127.9.142.130:42891)
0811 07:20:40.728500 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.728503 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.728628 (+ 125us) server_negotiation.cc:407] Connection header received
0811 07:20:40.728695 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.728696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.728707 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.728790 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:40.729028 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.729559 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.730550 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.731009 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.731091 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.731100 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.731272 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.731317 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 07:20:40.731379 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.728327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:37743 (local address 127.9.142.129:55823)
0811 07:20:40.728485 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:40.728500 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:40.728582 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:40.728790 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:40.728791 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:40.728793 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:40.728891 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.728894 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.729580 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.729581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.730465 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.730467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.731044 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.731045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.731125 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.731130 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:20:40.731189 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 07:20:40.731248 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":86,"threads_started":1}
I20260811 07:20:40.731387 9094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.728340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:42891 (local address 127.9.142.129:51745)
0811 07:20:40.728524 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:40.728535 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:40.728620 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:40.728798 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:40.728799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:40.728801 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:40.728941 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.728944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.729650 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.729651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.730445 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:40.730448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.731107 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.731108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:40.731162 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.731166 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:40.731243 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 07:20:40.731279 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":18,"thread_start_us":73,"threads_started":1}
I20260811 07:20:40.731832 8705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de6a01829ca40e183d430cae577366a" candidate_uuid: "b78ab271ba4847328c2af72f41f3e4b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e7c2963213450f9e2d84c178a32434" is_pre_election: true
I20260811 07:20:40.732045 8705 raft_consensus.cc:2454] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b78ab271ba4847328c2af72f41f3e4b2 in term 0.
I20260811 07:20:40.732008 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de6a01829ca40e183d430cae577366a" candidate_uuid: "b78ab271ba4847328c2af72f41f3e4b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "180c7808cbca4fb880e8e26e369ca19f" is_pre_election: true
I20260811 07:20:40.732141 8955 raft_consensus.cc:2454] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b78ab271ba4847328c2af72f41f3e4b2 in term 0.
I20260811 07:20:40.732349 8325 leader_election.cc:302] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b78ab271ba4847328c2af72f41f3e4b2, f1e7c2963213450f9e2d84c178a32434; no voters:
I20260811 07:20:40.732653 9088 raft_consensus.cc:2781] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:20:40.732730 9088 raft_consensus.cc:482] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:20:40.732751 9088 raft_consensus.cc:3037] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:40.733521 9088 raft_consensus.cc:504] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } }
I20260811 07:20:40.733676 9088 leader_election.cc:288] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [CANDIDATE]: Term 1 election: Requested vote from peers f1e7c2963213450f9e2d84c178a32434 (127.9.142.130:42891), 180c7808cbca4fb880e8e26e369ca19f (127.9.142.131:37743)
I20260811 07:20:40.733870 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de6a01829ca40e183d430cae577366a" candidate_uuid: "b78ab271ba4847328c2af72f41f3e4b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "180c7808cbca4fb880e8e26e369ca19f"
I20260811 07:20:40.733959 8955 raft_consensus.cc:3037] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:40.733968 8705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9de6a01829ca40e183d430cae577366a" candidate_uuid: "b78ab271ba4847328c2af72f41f3e4b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e7c2963213450f9e2d84c178a32434"
I20260811 07:20:40.734102 8705 raft_consensus.cc:3037] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:40.734736 8955 raft_consensus.cc:2454] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b78ab271ba4847328c2af72f41f3e4b2 in term 1.
I20260811 07:20:40.734968 8322 leader_election.cc:302] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 180c7808cbca4fb880e8e26e369ca19f, b78ab271ba4847328c2af72f41f3e4b2; no voters:
I20260811 07:20:40.735016 8705 raft_consensus.cc:2454] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b78ab271ba4847328c2af72f41f3e4b2 in term 1.
I20260811 07:20:40.735118 9088 raft_consensus.cc:2781] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:40.735327 9088 raft_consensus.cc:686] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [term 1 LEADER]: Becoming Leader. State: Replica: b78ab271ba4847328c2af72f41f3e4b2, State: Running, Role: LEADER
I20260811 07:20:40.735471 9088 consensus_queue.cc:237] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } }
I20260811 07:20:40.736439 8156 catalog_manager.cc:5495] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b78ab271ba4847328c2af72f41f3e4b2 (127.9.142.129). New cstate: current_term: 1 leader_uuid: "b78ab271ba4847328c2af72f41f3e4b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b78ab271ba4847328c2af72f41f3e4b2" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 44019 } health_report { overall_health: HEALTHY } } }
I20260811 07:20:40.764526 9073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.762005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44154 (local address 127.9.142.129:44019)
0811 07:20:40.762078 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.762080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.762090 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:20:40.762133 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.762134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.762153 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.762215 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:20:40.762358 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.762828 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.763623 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.763898 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.763960 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.764170 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:20:40.764264 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:20:40.764347 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.764447 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.764460 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 07:20:40.766872 8955 raft_consensus.cc:1261] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [term 1 FOLLOWER]: Refusing update from remote peer b78ab271ba4847328c2af72f41f3e4b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:40.766983 8705 raft_consensus.cc:1261] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [term 1 FOLLOWER]: Refusing update from remote peer b78ab271ba4847328c2af72f41f3e4b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:40.767356 9098 consensus_queue.cc:1035] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "180c7808cbca4fb880e8e26e369ca19f" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 37743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:40.767518 9088 consensus_queue.cc:1035] T 9de6a01829ca40e183d430cae577366a P b78ab271ba4847328c2af72f41f3e4b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1e7c2963213450f9e2d84c178a32434" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 42891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:40.770107 9110 mvcc.cc:205] Tried to move back new op lower bound from 7317228915778039808 to 7317228915653210112. Current Snapshot: MvccSnapshot[applied={T|T < 7317228915778039808}]
I20260811 07:20:40.771214 9111 mvcc.cc:205] Tried to move back new op lower bound from 7317228915778039808 to 7317228915653210112. Current Snapshot: MvccSnapshot[applied={T|T < 7317228915778039808}]
I20260811 07:20:40.772866 8155 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:40.772964 8155 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:40.773775 8155 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2e2415dfd249491994c30d40dd0842dd: Sending DeleteTablet for 3 replicas of tablet 9de6a01829ca40e183d430cae577366a
I20260811 07:20:40.774130 8672 tablet_service.cc:1514] Processing DeleteTablet for tablet 9de6a01829ca40e183d430cae577366a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:40 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:59720
I20260811 07:20:40.774366 8919 tablet_service.cc:1514] Processing DeleteTablet for tablet 9de6a01829ca40e183d430cae577366a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:40 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:50230
I20260811 07:20:40.774493 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 8288
I20260811 07:20:40.775077 9124 tablet_replica.cc:330] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: stopping tablet replica
I20260811 07:20:40.775127 9121 tablet_replica.cc:330] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: stopping tablet replica
I20260811 07:20:40.775216 9124 raft_consensus.cc:2229] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:40.775339 9121 raft_consensus.cc:2229] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:40.775480 9124 raft_consensus.cc:2258] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:40.775539 9121 raft_consensus.cc:2258] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:40.778070 9124 ts_tablet_manager.cc:1905] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:40.778074 9121 ts_tablet_manager.cc:1905] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:40.780373 9121 ts_tablet_manager.cc:1918] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:40.780505 9121 log.cc:1196] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/9de6a01829ca40e183d430cae577366a
I20260811 07:20:40.780845 9121 ts_tablet_manager.cc:1939] T 9de6a01829ca40e183d430cae577366a P f1e7c2963213450f9e2d84c178a32434: Deleting consensus metadata
I20260811 07:20:40.781422 8137 catalog_manager.cc:4841] TS f1e7c2963213450f9e2d84c178a32434 (127.9.142.130:42891): tablet 9de6a01829ca40e183d430cae577366a (table test-table [id=2bee22b534b44ea4989bebd856b56670]) successfully deleted
I20260811 07:20:40.782949 9124 ts_tablet_manager.cc:1918] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:40.783066 9124 log.cc:1196] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/9de6a01829ca40e183d430cae577366a
I20260811 07:20:40.783324 9124 ts_tablet_manager.cc:1939] T 9de6a01829ca40e183d430cae577366a P 180c7808cbca4fb880e8e26e369ca19f: Deleting consensus metadata
I20260811 07:20:40.783823 8135 catalog_manager.cc:4841] TS 180c7808cbca4fb880e8e26e369ca19f (127.9.142.131:37743): tablet 9de6a01829ca40e183d430cae577366a (table test-table [id=2bee22b534b44ea4989bebd856b56670]) successfully deleted
W20260811 07:20:40.787776 8137 connection.cc:535] client connection to 127.9.142.129:44019 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 07:20:40.787938 8137 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:20:40.788092 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 8548
I20260811 07:20:40.791383 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.791208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:44019 (local address 127.0.0.1:44160)
0811 07:20:40.791268 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:40.791332 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:44019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 07:20:40.791570 8137 catalog_manager.cc:4584] TS b78ab271ba4847328c2af72f41f3e4b2 (127.9.142.129:44019): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9de6a01829ca40e183d430cae577366a: Network error: Client connection negotiation failed: client connection to 127.9.142.129:44019: connect: Connection refused (error 111)
I20260811 07:20:40.798146 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 8792
I20260811 07:20:40.817138 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 8100
2026-08-11T07:20:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2403 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T07:20:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:40Z Disabled control of system clock
I20260811 07:20:40.855654 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:37421
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:34641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:37421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:40.943859 9132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:40.944114 9132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:40.944135 9132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:40.945317 9132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:40.945353 9132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:40.945366 9132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:40.945379 9132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:40.945390 9132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:40.946671 9132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:37421
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:37421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:40.946874 9132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:40.947108 9132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:40.951720 9142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:40.951721 9145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:40.951730 9143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:40.952176 9132 server_base.cc:1034] running on GCE node
I20260811 07:20:40.952431 9132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:40.952665 9132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:40.953816 9132 hybrid_clock.cc:648] HybridClock initialized: now 1786432840953797 us; error 34 us; skew 500 ppm
I20260811 07:20:40.955155 9132 webserver.cc:460] Webserver started at http://127.9.142.190:42021/ using document root <none> and password file <none>
I20260811 07:20:40.955410 9132 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:40.955459 9132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:40.955634 9132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:40.956717 9132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "1f66530cefa7407589d462c2ca5c5f06"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "bc7c934d415345b46918fb421f58ceec"
server_key_iv: "d6faf030f0f5373940ae7fe0363931a3"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.957093 9132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "1f66530cefa7407589d462c2ca5c5f06"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "bc7c934d415345b46918fb421f58ceec"
server_key_iv: "d6faf030f0f5373940ae7fe0363931a3"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.958391 9132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:20:40.959080 9157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:40.959244 9132 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:20:40.959352 9132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "1f66530cefa7407589d462c2ca5c5f06"
format_stamp: "Formatted at 2026-08-11 07:20:40 on dist-test-slave-7f01"
server_key: "bc7c934d415345b46918fb421f58ceec"
server_key_iv: "d6faf030f0f5373940ae7fe0363931a3"
server_key_version: "encryptionkey@0"
I20260811 07:20:40.959436 9132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:40.969172 9132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:40.969476 9132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:40.969640 9132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:40.973688 9132 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:37421
I20260811 07:20:40.973732 9250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:37421 every 8 connection(s)
I20260811 07:20:40.974098 9132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:40.975077 9252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:40.977407 9252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06: Bootstrap starting.
I20260811 07:20:40.977952 9252 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:40.978210 9252 log.cc:824] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:40.978842 9252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06: No bootstrap required, opened a new log
I20260811 07:20:40.980438 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 9132
I20260811 07:20:40.980564 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:40.980523 9252 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f66530cefa7407589d462c2ca5c5f06" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37421 } }
I20260811 07:20:40.980731 9252 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:40.980777 9252 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f66530cefa7407589d462c2ca5c5f06, State: Initialized, Role: FOLLOWER
I20260811 07:20:40.980798 9786 external_mini_cluster.cc:1428] Setting key 9656b9676b796f9e4332d1683572e4c6
I20260811 07:20:40.980942 9252 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f66530cefa7407589d462c2ca5c5f06" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37421 } }
I20260811 07:20:40.981030 9252 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:40.981055 9252 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:40.981122 9252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:40.981802 9252 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f66530cefa7407589d462c2ca5c5f06" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37421 } }
I20260811 07:20:40.981930 9252 leader_election.cc:302] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f66530cefa7407589d462c2ca5c5f06; no voters:
I20260811 07:20:40.982110 9252 leader_election.cc:288] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:40.982134 9262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:40.982283 9262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [term 1 LEADER]: Becoming Leader. State: Replica: 1f66530cefa7407589d462c2ca5c5f06, State: Running, Role: LEADER
I20260811 07:20:40.982366 9252 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:40.982374 9262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f66530cefa7407589d462c2ca5c5f06" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37421 } }
I20260811 07:20:40.982774 9262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f66530cefa7407589d462c2ca5c5f06. Latest consensus state: current_term: 1 leader_uuid: "1f66530cefa7407589d462c2ca5c5f06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f66530cefa7407589d462c2ca5c5f06" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37421 } } }
I20260811 07:20:40.982847 9262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:40.982997 9263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f66530cefa7407589d462c2ca5c5f06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f66530cefa7407589d462c2ca5c5f06" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 37421 } } }
I20260811 07:20:40.983049 9263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:40.983157 9273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:40.983850 9273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:40.985530 9273 catalog_manager.cc:1347] Generated new cluster ID: 47b67b770c8c4a81ba835fb8e91c1774
I20260811 07:20:40.985585 9273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:40.987272 9261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:40.981348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41148 (local address 127.9.142.190:37421)
0811 07:20:40.981582 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:40.981588 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:40.981614 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:20:40.981709 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:40.981714 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:40.981774 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:40.981946 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:40.982211 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.984021 (+ 1810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.985120 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:40.985718 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:40.985844 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:40.986561 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:40.986565 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:40.986565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:40.986783 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:40.986824 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:40.986839 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:40.986911 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:40.986981 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 07:20:40.987061 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":116,"threads_started":1}
I20260811 07:20:40.991631 9273 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:40.992316 9273 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:40.998831 9273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06: Generated new TSK 0
I20260811 07:20:40.999013 9273 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:41.007220 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37421
--builtin_ntp_servers=127.9.142.148:34641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:41.092162 9300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:41.092381 9300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:41.092403 9300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:41.093549 9300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:41.093590 9300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:41.093616 9300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:20:41.094960 9300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:41.095206 9300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:41.095528 9300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:41.100829 9310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:41.100924 9313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:41.100991 9300 server_base.cc:1034] running on GCE node
W20260811 07:20:41.100831 9311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:41.101218 9300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:41.101514 9300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:41.102687 9300 hybrid_clock.cc:648] HybridClock initialized: now 1786432841102673 us; error 27 us; skew 500 ppm
I20260811 07:20:41.104283 9300 webserver.cc:460] Webserver started at http://127.9.142.129:40285/ using document root <none> and password file <none>
I20260811 07:20:41.104566 9300 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:41.104614 9300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:41.104749 9300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:41.105855 9300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "538118832a9349a5b15bf84e32d1bb57"
format_stamp: "Formatted at 2026-08-11 07:20:41 on dist-test-slave-7f01"
server_key: "f34a6f03b99d9fee6a1fea1ae0322e5c"
server_key_iv: "ae5cef5f348166c0410828983cb6d185"
server_key_version: "encryptionkey@0"
I20260811 07:20:41.106227 9300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "538118832a9349a5b15bf84e32d1bb57"
format_stamp: "Formatted at 2026-08-11 07:20:41 on dist-test-slave-7f01"
server_key: "f34a6f03b99d9fee6a1fea1ae0322e5c"
server_key_iv: "ae5cef5f348166c0410828983cb6d185"
server_key_version: "encryptionkey@0"
I20260811 07:20:41.107590 9300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 07:20:41.108542 9325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:41.108696 9300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:20:41.108788 9300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "538118832a9349a5b15bf84e32d1bb57"
format_stamp: "Formatted at 2026-08-11 07:20:41 on dist-test-slave-7f01"
server_key: "f34a6f03b99d9fee6a1fea1ae0322e5c"
server_key_iv: "ae5cef5f348166c0410828983cb6d185"
server_key_version: "encryptionkey@0"
I20260811 07:20:41.108858 9300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:41.120575 9300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:41.120905 9300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:41.121063 9300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:41.121301 9300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:41.121652 9300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:41.121711 9300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:41.121753 9300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:41.121780 9300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:41.128157 9300 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:32791
I20260811 07:20:41.128204 9533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:32791 every 8 connection(s)
I20260811 07:20:41.128564 9300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:20:41.133352 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 9300
I20260811 07:20:41.133491 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:20:41.133754 9786 external_mini_cluster.cc:1428] Setting key d960452993b7b5c44035c030ca180476
I20260811 07:20:41.134007 9261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.129327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:47439 (local address 127.9.142.190:37421)
0811 07:20:41.129408 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.129410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.129696 (+ 286us) server_negotiation.cc:407] Connection header received
0811 07:20:41.130213 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.130214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.130226 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.130281 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:41.130970 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.131471 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.132517 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.132705 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.132759 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.133657 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:41.133658 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:41.133659 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:41.133663 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:41.133678 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:41.133682 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:41.133719 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.133851 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.133907 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:20:41.134189 9540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.129309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:37421 (local address 127.9.142.129:47439)
0811 07:20:41.129561 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:41.129604 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:41.130123 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:41.130351 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:41.130354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:41.130363 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:41.130896 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.130901 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.131555 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.131556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.132438 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.132441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.132803 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.132804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.132916 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.133483 (+ 567us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:20:41.133483 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:41.133524 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:20:41.133554 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:41.133743 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:41.133750 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:41.133753 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:20:41.133839 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 07:20:41.133965 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":139,"threads_started":1}
I20260811 07:20:41.134711 9536 heartbeater.cc:347] Connected to a master server at 127.9.142.190:37421
I20260811 07:20:41.134799 9536 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:41.134896 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37421
--builtin_ntp_servers=127.9.142.148:34641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:20:41.135033 9536 heartbeater.cc:511] Master 127.9.142.190:37421 requested a full tablet report, sending...
I20260811 07:20:41.135586 9183 ts_manager.cc:194] Registered new tserver with Master: 538118832a9349a5b15bf84e32d1bb57 (127.9.142.129:32791)
I20260811 07:20:41.136530 9183 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.129:47439
W20260811 07:20:41.220360 9541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:41.220619 9541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:41.220657 9541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:41.221757 9541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:41.221822 9541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:41.221873 9541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:20:41.223202 9541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:41.223465 9541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:41.223830 9541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:41.228958 9557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:41.228966 9552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:41.229024 9553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:41.229172 9541 server_base.cc:1034] running on GCE node
I20260811 07:20:41.229384 9541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:41.229584 9541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:41.230784 9541 hybrid_clock.cc:648] HybridClock initialized: now 1786432841230746 us; error 32 us; skew 500 ppm
I20260811 07:20:41.232154 9541 webserver.cc:460] Webserver started at http://127.9.142.130:38669/ using document root <none> and password file <none>
I20260811 07:20:41.232389 9541 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:41.232436 9541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:41.232575 9541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:41.233616 9541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "1a866bdda73342ac9db8d73e78d5386a"
format_stamp: "Formatted at 2026-08-11 07:20:41 on dist-test-slave-7f01"
server_key: "c0aee6a30596df6307874659cec7ea54"
server_key_iv: "9a2e124bc7a5404c2893560a72282979"
server_key_version: "encryptionkey@0"
I20260811 07:20:41.233981 9541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "1a866bdda73342ac9db8d73e78d5386a"
format_stamp: "Formatted at 2026-08-11 07:20:41 on dist-test-slave-7f01"
server_key: "c0aee6a30596df6307874659cec7ea54"
server_key_iv: "9a2e124bc7a5404c2893560a72282979"
server_key_version: "encryptionkey@0"
I20260811 07:20:41.235288 9541 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:20:41.236088 9566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:41.236282 9541 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:20:41.236382 9541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "1a866bdda73342ac9db8d73e78d5386a"
format_stamp: "Formatted at 2026-08-11 07:20:41 on dist-test-slave-7f01"
server_key: "c0aee6a30596df6307874659cec7ea54"
server_key_iv: "9a2e124bc7a5404c2893560a72282979"
server_key_version: "encryptionkey@0"
I20260811 07:20:41.236455 9541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:41.253679 9541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:41.254006 9541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:41.254142 9541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:41.254401 9541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:41.254756 9541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:41.254801 9541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:41.254823 9541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:41.254860 9541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:41.260864 9541 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:35753
I20260811 07:20:41.260982 9775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:35753 every 8 connection(s)
I20260811 07:20:41.261300 9541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:20:41.266881 9261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.262188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:52139 (local address 127.9.142.190:37421)
0811 07:20:41.262259 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.262261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.262563 (+ 302us) server_negotiation.cc:407] Connection header received
0811 07:20:41.263132 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.263133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.263145 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.263205 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:41.264045 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.264560 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.265523 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.265721 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.265784 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.266606 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:41.266607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:41.266608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:41.266612 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:41.266627 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:41.266631 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:41.266681 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.266777 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.266806 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:20:41.267050 9778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.262143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:37421 (local address 127.9.142.130:52139)
0811 07:20:41.262429 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:41.262479 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:41.262983 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:41.263330 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:41.263334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:41.263345 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:41.263955 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.263961 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.264647 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.264647 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.265436 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.265438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.265803 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.265804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.265915 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.266464 (+ 549us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:20:41.266464 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:41.266493 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:20:41.266517 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:41.266692 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:41.266696 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:41.266699 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:20:41.266751 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 07:20:41.266843 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":115,"threads_started":1}
I20260811 07:20:41.267573 9776 heartbeater.cc:347] Connected to a master server at 127.9.142.190:37421
I20260811 07:20:41.267664 9776 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:41.267884 9776 heartbeater.cc:511] Master 127.9.142.190:37421 requested a full tablet report, sending...
I20260811 07:20:41.268253 9183 ts_manager.cc:194] Registered new tserver with Master: 1a866bdda73342ac9db8d73e78d5386a (127.9.142.130:35753)
I20260811 07:20:41.268642 9183 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.130:52139
I20260811 07:20:41.271435 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 9541
I20260811 07:20:41.271531 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:20:41.271773 9786 external_mini_cluster.cc:1428] Setting key ea84cc892fbcf5492dad6c73e4edc07e
I20260811 07:20:41.272724 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37421
--builtin_ntp_servers=127.9.142.148:34641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:41.360545 9781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:41.360806 9781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:41.360843 9781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:41.362102 9781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:41.362161 9781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:41.362205 9781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:20:41.363718 9781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:34641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:37421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:41.364022 9781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:41.364333 9781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:41.369509 9803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:41.369591 9781 server_base.cc:1034] running on GCE node
W20260811 07:20:41.369567 9802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:41.369524 9806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:41.369890 9781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:41.370150 9781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:41.371320 9781 hybrid_clock.cc:648] HybridClock initialized: now 1786432841371319 us; error 42 us; skew 500 ppm
I20260811 07:20:41.372630 9781 webserver.cc:460] Webserver started at http://127.9.142.131:43233/ using document root <none> and password file <none>
I20260811 07:20:41.372893 9781 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:41.372967 9781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:41.373184 9781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:41.374270 9781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "987800b0542c4023b7cbcaed0faf621e"
format_stamp: "Formatted at 2026-08-11 07:20:41 on dist-test-slave-7f01"
server_key: "9f3dddba0ae565a7e1f8ef8cf8980d94"
server_key_iv: "a0766615d5401620e7f956273ad8efee"
server_key_version: "encryptionkey@0"
I20260811 07:20:41.374648 9781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "987800b0542c4023b7cbcaed0faf621e"
format_stamp: "Formatted at 2026-08-11 07:20:41 on dist-test-slave-7f01"
server_key: "9f3dddba0ae565a7e1f8ef8cf8980d94"
server_key_iv: "a0766615d5401620e7f956273ad8efee"
server_key_version: "encryptionkey@0"
I20260811 07:20:41.376044 9781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:20:41.376780 9817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:41.376983 9781 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:20:41.377089 9781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "987800b0542c4023b7cbcaed0faf621e"
format_stamp: "Formatted at 2026-08-11 07:20:41 on dist-test-slave-7f01"
server_key: "9f3dddba0ae565a7e1f8ef8cf8980d94"
server_key_iv: "a0766615d5401620e7f956273ad8efee"
server_key_version: "encryptionkey@0"
I20260811 07:20:41.377172 9781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:41.386068 9781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:41.386353 9781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:41.386507 9781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:41.386731 9781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:41.387079 9781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:41.387151 9781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:41.387190 9781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:41.387223 9781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:41.393493 9781 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:38137
I20260811 07:20:41.393543 10025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:38137 every 8 connection(s)
I20260811 07:20:41.393882 9781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:20:41.398953 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 9781
I20260811 07:20:41.399107 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:20:41.399397 9786 external_mini_cluster.cc:1428] Setting key b517f79020cf4f8dcbd2c5a6d2b227be
I20260811 07:20:41.399678 9261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.394652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:47373 (local address 127.9.142.190:37421)
0811 07:20:41.394715 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.394717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.394980 (+ 263us) server_negotiation.cc:407] Connection header received
0811 07:20:41.395548 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.395550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.395564 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.395618 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:41.396421 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.396940 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.397965 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.398170 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.398260 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.399297 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:41.399298 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:41.399299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:41.399305 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:41.399325 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:41.399331 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:41.399404 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.399573 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.399609 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 07:20:41.400010 10035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.394635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:37421 (local address 127.9.142.131:47373)
0811 07:20:41.394841 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:41.394874 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:41.395429 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:41.395695 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:41.395698 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:41.395707 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:41.396314 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.396319 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.397048 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.397049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.397839 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.397841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.398273 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.398274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.398414 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.399068 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:20:41.399069 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:41.399146 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:20:41.399180 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:41.399428 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:41.399435 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:41.399439 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:41.399586 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 07:20:41.399718 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260811 07:20:41.400642 10029 heartbeater.cc:347] Connected to a master server at 127.9.142.190:37421
I20260811 07:20:41.400782 10029 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:41.401000 10029 heartbeater.cc:511] Master 127.9.142.190:37421 requested a full tablet report, sending...
I20260811 07:20:41.401479 9183 ts_manager.cc:194] Registered new tserver with Master: 987800b0542c4023b7cbcaed0faf621e (127.9.142.131:38137)
I20260811 07:20:41.401877 9183 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.131:47373
I20260811 07:20:41.411955 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:20:41.417770 9261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.414007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41154 (local address 127.9.142.190:37421)
0811 07:20:41.414082 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.414085 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.414219 (+ 134us) server_negotiation.cc:407] Connection header received
0811 07:20:41.414283 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.414284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.414298 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.414354 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:41.414680 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.415188 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.416166 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.416375 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.416548 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.417344 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:41.417345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:41.417346 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:41.417351 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:41.417367 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:41.417372 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:41.417464 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.417612 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.417624 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:20:41.419924 9183 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41154:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:20:41.421728 9183 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:20:41.429229 10050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.424670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37268 (local address 127.9.142.129:32791)
0811 07:20:41.424888 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.424893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.424904 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:20:41.424955 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.424958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.424975 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.425055 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:41.425546 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.426697 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.427929 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.428797 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.428871 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.429062 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.429092 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.429134 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":90,"threads_started":1}
I20260811 07:20:41.429219 10044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.424310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:35753 (local address 127.0.0.1:37566)
0811 07:20:41.424675 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:41.424719 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:41.424807 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:41.425142 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:41.425145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:41.425149 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:41.425444 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.425447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.426334 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.426335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.427522 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.427525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.428781 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.428782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.428873 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.428958 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 07:20:41.429054 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:20:41.429110 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":7,"thread_start_us":69,"threads_started":1}
I20260811 07:20:41.429237 10045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.424389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:32791 (local address 127.0.0.1:37268)
0811 07:20:41.424803 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:41.424826 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:41.424887 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:41.425143 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:41.425146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:41.425148 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:41.425453 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.425457 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.426799 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.426800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.427846 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.427848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.428890 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.428891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.428957 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.428962 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:20:41.429026 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 07:20:41.429085 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":9,"thread_start_us":124,"threads_started":1}
I20260811 07:20:41.429705 10046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.424458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37566 (local address 127.9.142.130:35753)
0811 07:20:41.424706 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.424711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.424899 (+ 188us) server_negotiation.cc:407] Connection header received
0811 07:20:41.424967 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.424970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.424986 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.425059 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:41.425533 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.426242 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.427625 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.428558 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.428642 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.428739 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.429565 (+ 826us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.429624 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":93,"threads_started":1}
I20260811 07:20:41.429790 10043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.424325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:38137 (local address 127.0.0.1:55894)
0811 07:20:41.424759 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:41.424769 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:41.424811 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:41.425332 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:41.425333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:41.425334 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:41.425453 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.425455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.427821 (+ 2366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.427823 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.428539 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.428541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.429553 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.429554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.429605 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.429607 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:20:41.429682 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 07:20:41.429725 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":90,"threads_started":1}
I20260811 07:20:41.430094 10048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.424581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55894 (local address 127.9.142.131:38137)
0811 07:20:41.425022 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.425025 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.425035 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:20:41.425075 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.425077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.425185 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.425259 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:41.425544 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.426688 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.428642 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.429378 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.429447 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.429524 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.429701 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.429740 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":112,"threads_started":1}
I20260811 07:20:41.430644 9655 tablet_service.cc:1467] Processing CreateTablet for tablet e285f42fc14e4a36b99c7cff256428fe (DEFAULT_TABLE table=test-table [id=7c73afedfe36433397148007f0812309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:41.430680 9896 tablet_service.cc:1467] Processing CreateTablet for tablet e285f42fc14e4a36b99c7cff256428fe (DEFAULT_TABLE table=test-table [id=7c73afedfe36433397148007f0812309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:41.431053 9896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e285f42fc14e4a36b99c7cff256428fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:41.431053 9655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e285f42fc14e4a36b99c7cff256428fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:41.434194 10051 tablet_bootstrap.cc:492] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: Bootstrap starting.
I20260811 07:20:41.434934 10052 tablet_bootstrap.cc:492] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: Bootstrap starting.
I20260811 07:20:41.435130 10051 tablet_bootstrap.cc:654] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:41.435247 9412 tablet_service.cc:1467] Processing CreateTablet for tablet e285f42fc14e4a36b99c7cff256428fe (DEFAULT_TABLE table=test-table [id=7c73afedfe36433397148007f0812309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:41.435622 10051 log.cc:824] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:41.435778 9412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e285f42fc14e4a36b99c7cff256428fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:41.435808 10052 tablet_bootstrap.cc:654] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:41.436214 10052 log.cc:824] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:41.436569 10051 tablet_bootstrap.cc:492] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: No bootstrap required, opened a new log
I20260811 07:20:41.436641 10051 ts_tablet_manager.cc:1397] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:20:41.437135 10052 tablet_bootstrap.cc:492] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: No bootstrap required, opened a new log
I20260811 07:20:41.437327 10052 ts_tablet_manager.cc:1397] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:20:41.439431 10055 tablet_bootstrap.cc:492] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57: Bootstrap starting.
I20260811 07:20:41.439567 10051 raft_consensus.cc:348] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } }
I20260811 07:20:41.439769 10051 raft_consensus.cc:374] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:41.439818 10051 raft_consensus.cc:729] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987800b0542c4023b7cbcaed0faf621e, State: Initialized, Role: FOLLOWER
I20260811 07:20:41.439947 10051 consensus_queue.cc:260] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } }
I20260811 07:20:41.440256 10051 ts_tablet_manager.cc:1428] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 07:20:41.440229 10052 raft_consensus.cc:348] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } }
I20260811 07:20:41.440385 10055 tablet_bootstrap.cc:654] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:41.440400 10029 heartbeater.cc:503] Master 127.9.142.190:37421 was elected leader, sending a full tablet report...
I20260811 07:20:41.440403 10052 raft_consensus.cc:374] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:41.440445 10052 raft_consensus.cc:729] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a866bdda73342ac9db8d73e78d5386a, State: Initialized, Role: FOLLOWER
I20260811 07:20:41.440577 10052 consensus_queue.cc:260] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } }
I20260811 07:20:41.440819 10055 log.cc:824] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:41.440856 10052 ts_tablet_manager.cc:1428] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 07:20:41.441066 9776 heartbeater.cc:503] Master 127.9.142.190:37421 was elected leader, sending a full tablet report...
I20260811 07:20:41.442142 10055 tablet_bootstrap.cc:492] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57: No bootstrap required, opened a new log
I20260811 07:20:41.442219 10055 ts_tablet_manager.cc:1397] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:20:41.444144 10055 raft_consensus.cc:348] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } }
I20260811 07:20:41.444296 10055 raft_consensus.cc:374] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:41.444353 10055 raft_consensus.cc:729] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538118832a9349a5b15bf84e32d1bb57, State: Initialized, Role: FOLLOWER
I20260811 07:20:41.444475 10055 consensus_queue.cc:260] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } }
I20260811 07:20:41.444726 10055 ts_tablet_manager.cc:1428] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 07:20:41.444828 9536 heartbeater.cc:503] Master 127.9.142.190:37421 was elected leader, sending a full tablet report...
I20260811 07:20:41.446784 10066 raft_consensus.cc:482] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:41.446868 10066 raft_consensus.cc:504] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } }
I20260811 07:20:41.447180 10066 leader_election.cc:288] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a866bdda73342ac9db8d73e78d5386a (127.9.142.130:35753), 987800b0542c4023b7cbcaed0faf621e (127.9.142.131:38137)
I20260811 07:20:41.450114 10046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.447386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:35761 (local address 127.9.142.130:35753)
0811 07:20:41.447433 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.447435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.447444 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:20:41.447588 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.447589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.447607 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.447684 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:41.447878 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.448362 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.449362 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.449740 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.449824 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.449835 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.450000 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.450038 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 07:20:41.450139 10048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.447545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:53771 (local address 127.9.142.131:38137)
0811 07:20:41.447596 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.447598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.447606 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:20:41.447632 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.447633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.447642 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.447689 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:41.447877 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.448356 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.449376 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.449767 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.449852 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.449860 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.450027 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.450070 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:20:41.450161 9540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.447324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:35753 (local address 127.9.142.129:35761)
0811 07:20:41.447378 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:41.447389 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:41.447436 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:41.447690 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:41.447691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:41.447693 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:41.447787 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.447788 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.448458 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.448459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.449258 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.449260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.449854 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.449856 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.449925 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.449928 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:20:41.449994 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 07:20:41.450038 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":27}
I20260811 07:20:41.450224 10067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.447339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:38137 (local address 127.9.142.129:53771)
0811 07:20:41.447513 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:41.447524 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:41.447564 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:41.447690 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:41.447691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:41.447693 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:41.447796 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.447798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.448440 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.448441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.449269 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:41.449272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.449851 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.449852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:41.449932 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.449936 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:41.450018 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:20:41.450057 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":20,"thread_start_us":110,"threads_started":1}
I20260811 07:20:41.450493 9690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e285f42fc14e4a36b99c7cff256428fe" candidate_uuid: "538118832a9349a5b15bf84e32d1bb57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a866bdda73342ac9db8d73e78d5386a" is_pre_election: true
I20260811 07:20:41.450651 9690 raft_consensus.cc:2454] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538118832a9349a5b15bf84e32d1bb57 in term 0.
I20260811 07:20:41.450630 9933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e285f42fc14e4a36b99c7cff256428fe" candidate_uuid: "538118832a9349a5b15bf84e32d1bb57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "987800b0542c4023b7cbcaed0faf621e" is_pre_election: true
I20260811 07:20:41.450776 9933 raft_consensus.cc:2454] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538118832a9349a5b15bf84e32d1bb57 in term 0.
I20260811 07:20:41.450876 9327 leader_election.cc:302] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a866bdda73342ac9db8d73e78d5386a, 538118832a9349a5b15bf84e32d1bb57; no voters:
I20260811 07:20:41.451001 10066 raft_consensus.cc:2781] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:20:41.451062 10066 raft_consensus.cc:482] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:20:41.451085 10066 raft_consensus.cc:3037] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:41.451797 10066 raft_consensus.cc:504] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } }
I20260811 07:20:41.452016 10066 leader_election.cc:288] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [CANDIDATE]: Term 1 election: Requested vote from peers 1a866bdda73342ac9db8d73e78d5386a (127.9.142.130:35753), 987800b0542c4023b7cbcaed0faf621e (127.9.142.131:38137)
I20260811 07:20:41.452087 9933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e285f42fc14e4a36b99c7cff256428fe" candidate_uuid: "538118832a9349a5b15bf84e32d1bb57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "987800b0542c4023b7cbcaed0faf621e"
I20260811 07:20:41.452168 9933 raft_consensus.cc:3037] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:41.452173 9690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e285f42fc14e4a36b99c7cff256428fe" candidate_uuid: "538118832a9349a5b15bf84e32d1bb57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a866bdda73342ac9db8d73e78d5386a"
I20260811 07:20:41.452244 9690 raft_consensus.cc:3037] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:41.453176 9933 raft_consensus.cc:2454] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538118832a9349a5b15bf84e32d1bb57 in term 1.
I20260811 07:20:41.453208 9690 raft_consensus.cc:2454] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538118832a9349a5b15bf84e32d1bb57 in term 1.
I20260811 07:20:41.453387 9335 leader_election.cc:302] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538118832a9349a5b15bf84e32d1bb57, 987800b0542c4023b7cbcaed0faf621e; no voters:
I20260811 07:20:41.453497 10066 raft_consensus.cc:2781] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:41.453632 10066 raft_consensus.cc:686] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [term 1 LEADER]: Becoming Leader. State: Replica: 538118832a9349a5b15bf84e32d1bb57, State: Running, Role: LEADER
I20260811 07:20:41.453727 10066 consensus_queue.cc:237] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } }
I20260811 07:20:41.454545 9183 catalog_manager.cc:5495] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 538118832a9349a5b15bf84e32d1bb57 (127.9.142.129). New cstate: current_term: 1 leader_uuid: "538118832a9349a5b15bf84e32d1bb57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538118832a9349a5b15bf84e32d1bb57" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 32791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 } health_report { overall_health: UNKNOWN } } }
I20260811 07:20:41.465278 10050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.462908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37282 (local address 127.9.142.129:32791)
0811 07:20:41.462964 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:41.462966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:41.462996 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:20:41.463059 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:41.463060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:41.463079 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:41.463138 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:20:41.463304 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.463838 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.464594 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:41.464784 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:41.464842 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:41.464985 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:20:41.465077 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:20:41.465147 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:41.465193 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 07:20:41.465203 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 07:20:41.467530 9933 raft_consensus.cc:1261] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [term 1 FOLLOWER]: Refusing update from remote peer 538118832a9349a5b15bf84e32d1bb57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:41.467598 9690 raft_consensus.cc:1261] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [term 1 FOLLOWER]: Refusing update from remote peer 538118832a9349a5b15bf84e32d1bb57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:41.468051 10069 consensus_queue.cc:1035] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "987800b0542c4023b7cbcaed0faf621e" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 38137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:41.468218 10066 consensus_queue.cc:1035] T e285f42fc14e4a36b99c7cff256428fe P 538118832a9349a5b15bf84e32d1bb57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a866bdda73342ac9db8d73e78d5386a" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 35753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:41.470804 10073 mvcc.cc:205] Tried to move back new op lower bound from 7317228918647767040 to 7317228918595043328. Current Snapshot: MvccSnapshot[applied={T|T < 7317228918647767040}]
I20260811 07:20:41.470868 10075 mvcc.cc:205] Tried to move back new op lower bound from 7317228918647767040 to 7317228918595043328. Current Snapshot: MvccSnapshot[applied={T|T < 7317228918647767040}]
I20260811 07:20:41.474036 9182 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:41.474126 9182 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:41.475042 9182 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f66530cefa7407589d462c2ca5c5f06: Sending DeleteTablet for 3 replicas of tablet e285f42fc14e4a36b99c7cff256428fe
I20260811 07:20:41.475628 9655 tablet_service.cc:1514] Processing DeleteTablet for tablet e285f42fc14e4a36b99c7cff256428fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:41 UTC) from {username='slave'} at 127.0.0.1:37566
I20260811 07:20:41.475826 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 9300
I20260811 07:20:41.483548 9896 tablet_service.cc:1514] Processing DeleteTablet for tablet e285f42fc14e4a36b99c7cff256428fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:41 UTC) from {username='slave'} at 127.0.0.1:55894
I20260811 07:20:41.484050 10098 tablet_replica.cc:330] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: stopping tablet replica
I20260811 07:20:41.484256 10098 raft_consensus.cc:2229] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:41.484467 10098 raft_consensus.cc:2258] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:41.486573 10097 tablet_replica.cc:330] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: stopping tablet replica
I20260811 07:20:41.486729 10097 raft_consensus.cc:2229] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:41.486886 10097 raft_consensus.cc:2258] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:41.487257 10098 ts_tablet_manager.cc:1905] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:41.487516 10097 ts_tablet_manager.cc:1905] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:41.489812 10098 ts_tablet_manager.cc:1918] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:41.489830 10097 ts_tablet_manager.cc:1918] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:41.489960 10097 log.cc:1196] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/e285f42fc14e4a36b99c7cff256428fe
I20260811 07:20:41.489979 10098 log.cc:1196] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/e285f42fc14e4a36b99c7cff256428fe
I20260811 07:20:41.490278 10098 ts_tablet_manager.cc:1939] T e285f42fc14e4a36b99c7cff256428fe P 987800b0542c4023b7cbcaed0faf621e: Deleting consensus metadata
I20260811 07:20:41.490301 10097 ts_tablet_manager.cc:1939] T e285f42fc14e4a36b99c7cff256428fe P 1a866bdda73342ac9db8d73e78d5386a: Deleting consensus metadata
I20260811 07:20:41.491010 9165 catalog_manager.cc:4841] TS 987800b0542c4023b7cbcaed0faf621e (127.9.142.131:38137): tablet e285f42fc14e4a36b99c7cff256428fe (table test-table [id=7c73afedfe36433397148007f0812309]) successfully deleted
I20260811 07:20:41.491721 9160 catalog_manager.cc:4841] TS 1a866bdda73342ac9db8d73e78d5386a (127.9.142.130:35753): tablet e285f42fc14e4a36b99c7cff256428fe (table test-table [id=7c73afedfe36433397148007f0812309]) successfully deleted
W20260811 07:20:41.497648 9162 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:32791 (error 108)
I20260811 07:20:41.497867 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 9541
I20260811 07:20:41.509974 10043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:41.509716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:32791 (local address 127.0.0.1:37298)
0811 07:20:41.509817 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:41.509908 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:32791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 07:20:41.510236 9162 catalog_manager.cc:4584] TS 538118832a9349a5b15bf84e32d1bb57 (127.9.142.129:32791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e285f42fc14e4a36b99c7cff256428fe: Network error: Client connection negotiation failed: client connection to 127.9.142.129:32791: connect: Connection refused (error 111)
I20260811 07:20:41.514300 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 9781
I20260811 07:20:41.527040 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 9132
2026-08-11T07:20:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (709 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:41 dist-test-slave-7f01 krb5kdc[10103](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:41 dist-test-slave-7f01 krb5kdc[10103](info): set up 2 sockets
Aug 11 07:20:41 dist-test-slave-7f01 krb5kdc[10103](info): commencing operation
krb5kdc: starting...
W20260811 07:20:42.880568 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:42 dist-test-slave-7f01 krb5kdc[10103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:20:43.010948 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:44139
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:44139
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:43.093075 10143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:43.093335 10143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:43.093377 10143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:43.094563 10143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:43.094637 10143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:43.094664 10143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:43.094697 10143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:43.094719 10143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:43.096288 10143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:44139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:44139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:43.096568 10143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:43.096796 10143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:43.101667 10154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:43.101728 10152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:43.101686 10151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:43.101931 10143 server_base.cc:1034] running on GCE node
I20260811 07:20:43.102197 10143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:43.102495 10143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:43.103700 10143 hybrid_clock.cc:648] HybridClock initialized: now 1786432843103686 us; error 50 us; skew 500 ppm
Aug 11 07:20:43 dist-test-slave-7f01 krb5kdc[10103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432843, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:43.106508 10143 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:20:43.106956 10143 webserver.cc:460] Webserver started at http://127.9.142.190:45977/ using document root <none> and password file <none>
I20260811 07:20:43.107187 10143 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:43.107254 10143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:43.107410 10143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:43.108536 10143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "bceb0d5efeb54ad7853585b44b2323d5"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "307a12e3f14a4cfdbfeed2ce025d4dca"
server_key_iv: "29f427cb90b8c1cee59a6ee9a5e32c78"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.108915 10143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "bceb0d5efeb54ad7853585b44b2323d5"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "307a12e3f14a4cfdbfeed2ce025d4dca"
server_key_iv: "29f427cb90b8c1cee59a6ee9a5e32c78"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.110236 10143 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 07:20:43.110980 10166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.111186 10143 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:20:43.111302 10143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "bceb0d5efeb54ad7853585b44b2323d5"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "307a12e3f14a4cfdbfeed2ce025d4dca"
server_key_iv: "29f427cb90b8c1cee59a6ee9a5e32c78"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.111378 10143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:43.128921 10143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:43.131722 10143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:43.131990 10143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:43.136628 10143 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:44139
I20260811 07:20:43.136685 10273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:44139 every 8 connection(s)
I20260811 07:20:43.137051 10143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:43.138072 10274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:43.140697 10274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5: Bootstrap starting.
I20260811 07:20:43.141283 10274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:43.141557 10274 log.cc:824] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:43.142298 10274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5: No bootstrap required, opened a new log
I20260811 07:20:43.144150 10274 raft_consensus.cc:348] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceb0d5efeb54ad7853585b44b2323d5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44139 } }
I20260811 07:20:43.144299 10274 raft_consensus.cc:374] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:43.144333 10274 raft_consensus.cc:729] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bceb0d5efeb54ad7853585b44b2323d5, State: Initialized, Role: FOLLOWER
I20260811 07:20:43.144476 10274 consensus_queue.cc:260] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceb0d5efeb54ad7853585b44b2323d5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44139 } }
I20260811 07:20:43.144560 10274 raft_consensus.cc:388] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:43.144585 10274 raft_consensus.cc:482] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:43.144615 10274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:43.145119 10274 raft_consensus.cc:504] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceb0d5efeb54ad7853585b44b2323d5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44139 } }
I20260811 07:20:43.145210 10274 leader_election.cc:302] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bceb0d5efeb54ad7853585b44b2323d5; no voters:
I20260811 07:20:43.145345 10274 leader_election.cc:288] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:43.145416 10280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:43.145601 10280 raft_consensus.cc:686] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [term 1 LEADER]: Becoming Leader. State: Replica: bceb0d5efeb54ad7853585b44b2323d5, State: Running, Role: LEADER
I20260811 07:20:43.145649 10274 sys_catalog.cc:564] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:43.145699 10280 consensus_queue.cc:237] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceb0d5efeb54ad7853585b44b2323d5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44139 } }
I20260811 07:20:43.146077 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 10143
I20260811 07:20:43.146085 10281 sys_catalog.cc:455] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bceb0d5efeb54ad7853585b44b2323d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceb0d5efeb54ad7853585b44b2323d5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44139 } } }
I20260811 07:20:43.146200 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:43.146199 10281 sys_catalog.cc:458] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:43.146260 10283 sys_catalog.cc:455] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bceb0d5efeb54ad7853585b44b2323d5. Latest consensus state: current_term: 1 leader_uuid: "bceb0d5efeb54ad7853585b44b2323d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bceb0d5efeb54ad7853585b44b2323d5" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 44139 } } }
I20260811 07:20:43.146347 10283 sys_catalog.cc:458] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:43.146447 9786 external_mini_cluster.cc:1428] Setting key 1a5038c9db6066d795c4f8e4287767e0
I20260811 07:20:43.146471 10286 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:43.147240 10286 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:43.148880 10286 catalog_manager.cc:1347] Generated new cluster ID: e36657dc03fa45c48be6c3e9544c54cd
I20260811 07:20:43.148934 10286 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:20:43 dist-test-slave-7f01 krb5kdc[10103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:43.158108 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.147225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53454 (local address 127.9.142.190:44139)
0811 07:20:43.147422 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.147431 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.148051 (+ 620us) server_negotiation.cc:407] Connection header received
0811 07:20:43.148267 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.148284 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.148332 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.148474 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:43.149364 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.150284 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.151054 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.151494 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.151616 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.154088 (+ 2472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:43.154091 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:43.154091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:43.154112 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:43.156470 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.156847 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.156850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.156851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.156960 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.157186 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.157187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.157187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.157479 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:43.157668 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.157737 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.157894 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":87,"threads_started":1}
I20260811 07:20:43.163731 10286 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:43.164255 10286 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:43.180572 10286 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5: Generated new TSK 0
I20260811 07:20:43.180807 10286 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.142.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
Entry for principal kudu/127.9.142.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab.
I20260811 07:20:43.218948 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44139
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:43.317155 10322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:43.317400 10322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:43.317440 10322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:43.318591 10322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:43.318661 10322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:43.318707 10322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:20:43.320276 10322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.129.keytab
--principal=kudu/127.9.142.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:43.320681 10322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:43.320987 10322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:43.326548 10333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:43.326548 10338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:43.326859 10322 server_base.cc:1034] running on GCE node
W20260811 07:20:43.326884 10332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:43.327167 10322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:43.327442 10322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:43.328615 10322 hybrid_clock.cc:648] HybridClock initialized: now 1786432843328596 us; error 34 us; skew 500 ppm
Aug 11 07:20:43 dist-test-slave-7f01 krb5kdc[10103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432843, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:43.331290 10322 init.cc:377] Logged in from keytab as kudu/127.9.142.129@KRBTEST.COM (short username kudu)
I20260811 07:20:43.331828 10322 webserver.cc:460] Webserver started at http://127.9.142.129:40235/ using document root <none> and password file <none>
I20260811 07:20:43.332093 10322 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:43.332141 10322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:43.332279 10322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:43.333405 10322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "1794ff3df7e64cd59208df8c357ee02c"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "9dab2c258616233f3a7c4a67f347354b"
server_key_iv: "5c5fbfa2ba01d9b20aa18f277715b6b1"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.333799 10322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "1794ff3df7e64cd59208df8c357ee02c"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "9dab2c258616233f3a7c4a67f347354b"
server_key_iv: "5c5fbfa2ba01d9b20aa18f277715b6b1"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.335234 10322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:20:43.336151 10348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.336416 10322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:20:43.336540 10322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "1794ff3df7e64cd59208df8c357ee02c"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "9dab2c258616233f3a7c4a67f347354b"
server_key_iv: "5c5fbfa2ba01d9b20aa18f277715b6b1"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.336623 10322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:43.352214 10322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:43.354581 10322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:43.354753 10322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:43.355038 10322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:43.355417 10322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:43.355456 10322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.355479 10322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:43.355492 10322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.361939 10322 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:35953
I20260811 07:20:43.362033 10534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:35953 every 8 connection(s)
I20260811 07:20:43.362363 10322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:20:43.365643 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 10322
I20260811 07:20:43.365754 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:20:43.365985 9786 external_mini_cluster.cc:1428] Setting key b781060fac3c09151056604dd96d1f61
Aug 11 07:20:43 dist-test-slave-7f01 krb5kdc[10103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432843, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.129@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:43.374511 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.363161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:53007 (local address 127.9.142.190:44139)
0811 07:20:43.363206 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.363208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.363473 (+ 265us) server_negotiation.cc:407] Connection header received
0811 07:20:43.364078 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.364080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.364094 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.364158 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:43.365175 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.365914 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.367195 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.367547 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.367640 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.370316 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:43.370317 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:43.370318 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:43.370328 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:43.372326 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.373227 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.373229 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.373229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.373310 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.373697 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.373699 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.373699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.373860 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:43.373944 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.374252 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.374367 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:20:43.374554 10542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.363139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:44139 (local address 127.9.142.129:53007)
0811 07:20:43.363319 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:43.363371 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:43.363987 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:43.364245 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:43.364248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:43.364864 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:43.365078 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.365082 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.366011 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.366012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.367089 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.367092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.367654 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.367655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.367843 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.368448 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:43.368457 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:43.370203 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:43.372613 (+ 2410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:43.372632 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:43.372636 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:43.373097 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:43.373431 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:43.373432 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:43.373432 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:43.373607 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:43.373945 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:43.373952 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:43.374102 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 07:20:43.374202 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:20:43.374355 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
I20260811 07:20:43.375581 10539 heartbeater.cc:347] Connected to a master server at 127.9.142.190:44139
I20260811 07:20:43.375699 10539 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:43.375945 10539 heartbeater.cc:511] Master 127.9.142.190:44139 requested a full tablet report, sending...
I20260811 07:20:43.376674 10207 ts_manager.cc:194] Registered new tserver with Master: 1794ff3df7e64cd59208df8c357ee02c (127.9.142.129:35953)
I20260811 07:20:43.377396 10207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.129@KRBTEST.COM'} at 127.9.142.129:53007
WARNING: no policy specified for kudu/127.9.142.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
Entry for principal kudu/127.9.142.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab.
I20260811 07:20:43.398751 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44139
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:43.482933 10547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:43.483174 10547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:43.483212 10547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:43.484338 10547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:43.484407 10547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:43.484453 10547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:20:43.486128 10547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.130.keytab
--principal=kudu/127.9.142.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:43.486411 10547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:43.486645 10547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:43.491925 10563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:43.491968 10555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:43.491959 10547 server_base.cc:1034] running on GCE node
W20260811 07:20:43.492159 10556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:43.492363 10547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:43.492607 10547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:43.493760 10547 hybrid_clock.cc:648] HybridClock initialized: now 1786432843493747 us; error 26 us; skew 500 ppm
Aug 11 07:20:43 dist-test-slave-7f01 krb5kdc[10103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432843, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:43.496333 10547 init.cc:377] Logged in from keytab as kudu/127.9.142.130@KRBTEST.COM (short username kudu)
I20260811 07:20:43.496743 10547 webserver.cc:460] Webserver started at http://127.9.142.130:34041/ using document root <none> and password file <none>
I20260811 07:20:43.496977 10547 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:43.497047 10547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:43.497196 10547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:43.498190 10547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "3580e41ed26446f5ada0e5b68db96326"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "f6d13dde4653fc593dc517d26e4bd442"
server_key_iv: "66f75d8e830243a289ef27c86ffedcd5"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.498569 10547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "3580e41ed26446f5ada0e5b68db96326"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "f6d13dde4653fc593dc517d26e4bd442"
server_key_iv: "66f75d8e830243a289ef27c86ffedcd5"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.499944 10547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 07:20:43.500695 10575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.500885 10547 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:43.500995 10547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "3580e41ed26446f5ada0e5b68db96326"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "f6d13dde4653fc593dc517d26e4bd442"
server_key_iv: "66f75d8e830243a289ef27c86ffedcd5"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.501070 10547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:43.532341 10547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:43.534664 10547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:43.534833 10547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:43.535084 10547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:43.535395 10547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:43.535458 10547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.535498 10547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:43.535527 10547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.541755 10547 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:43917
I20260811 07:20:43.541810 10767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:43917 every 8 connection(s)
I20260811 07:20:43.542110 10547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:20:43.544961 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 10547
I20260811 07:20:43.545074 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:20:43.545302 9786 external_mini_cluster.cc:1428] Setting key dcfb17f46c79d67317ef3df84461fe68
Aug 11 07:20:43 dist-test-slave-7f01 krb5kdc[10103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432843, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.130@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:43.552754 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.542771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:44139 (local address 127.9.142.130:34501)
0811 07:20:43.542944 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:43.542979 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:43.543442 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:43.543692 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:43.543697 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:43.544491 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:43.544754 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.544759 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.545716 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.545717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.546862 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.546866 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.547341 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.547342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.547442 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.547976 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:43.547988 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:43.549555 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:43.551402 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:43.551409 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:43.551411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:43.551624 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:43.551870 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:43.551871 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:43.551871 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:43.551989 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:43.552292 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:43.552297 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:43.552406 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 07:20:43.552487 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 07:20:43.552603 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
I20260811 07:20:43.552770 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.542793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:34501 (local address 127.9.142.190:44139)
0811 07:20:43.542851 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.542853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.543068 (+ 215us) server_negotiation.cc:407] Connection header received
0811 07:20:43.543539 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.543540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.543554 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.543622 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:43.544851 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.545609 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.546941 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.547255 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.547337 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.549649 (+ 2312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:43.549650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:43.549651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:43.549658 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:43.551319 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.551704 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.551706 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.551706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.551795 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.552061 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.552062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.552063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.552220 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:43.552299 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.552538 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.552636 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:20:43.553313 10768 heartbeater.cc:347] Connected to a master server at 127.9.142.190:44139
I20260811 07:20:43.553426 10768 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:43.553608 10768 heartbeater.cc:511] Master 127.9.142.190:44139 requested a full tablet report, sending...
I20260811 07:20:43.554070 10207 ts_manager.cc:194] Registered new tserver with Master: 3580e41ed26446f5ada0e5b68db96326 (127.9.142.130:43917)
I20260811 07:20:43.554602 10207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.130@KRBTEST.COM'} at 127.9.142.130:34501
WARNING: no policy specified for kudu/127.9.142.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
Entry for principal kudu/127.9.142.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab.
I20260811 07:20:43.574148 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44139
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:41755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:43.655891 10777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:43.656077 10777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:43.656100 10777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:43.657228 10777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:43.657269 10777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:43.657325 10777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:20:43.658736 10777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:41755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.131.keytab
--principal=kudu/127.9.142.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:44139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:43.658936 10777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:43.659104 10777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:43.663985 10783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:43.664075 10787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:43.664124 10777 server_base.cc:1034] running on GCE node
W20260811 07:20:43.663986 10784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:43.664469 10777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:43.664717 10777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:43.665910 10777 hybrid_clock.cc:648] HybridClock initialized: now 1786432843665905 us; error 52 us; skew 500 ppm
Aug 11 07:20:43 dist-test-slave-7f01 krb5kdc[10103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432843, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:43.668484 10777 init.cc:377] Logged in from keytab as kudu/127.9.142.131@KRBTEST.COM (short username kudu)
I20260811 07:20:43.668859 10777 webserver.cc:460] Webserver started at http://127.9.142.131:37951/ using document root <none> and password file <none>
I20260811 07:20:43.669034 10777 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:43.669071 10777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:43.669158 10777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:43.670092 10777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "e6b0ef8551244ed4b34ccb57068d13f8"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "6ae249a574e98fb3395a7661df66a3f7"
server_key_iv: "6fa8786903444ab38be90f36849103ae"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.670383 10777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "e6b0ef8551244ed4b34ccb57068d13f8"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "6ae249a574e98fb3395a7661df66a3f7"
server_key_iv: "6fa8786903444ab38be90f36849103ae"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.671643 10777 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:20:43.672477 10801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.672727 10777 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:20:43.672847 10777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "e6b0ef8551244ed4b34ccb57068d13f8"
format_stamp: "Formatted at 2026-08-11 07:20:43 on dist-test-slave-7f01"
server_key: "6ae249a574e98fb3395a7661df66a3f7"
server_key_iv: "6fa8786903444ab38be90f36849103ae"
server_key_version: "encryptionkey@0"
I20260811 07:20:43.672905 10777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:43.687300 10777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:43.689366 10777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:43.689478 10777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:43.689646 10777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:43.689884 10777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:43.689914 10777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.689935 10777 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:43.689949 10777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:43.695923 10777 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:36779
I20260811 07:20:43.696038 10997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:36779 every 8 connection(s)
I20260811 07:20:43.696347 10777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:20:43.698568 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 10777
I20260811 07:20:43.698653 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:20:43.698829 9786 external_mini_cluster.cc:1428] Setting key 40c8638f5ec3a59913705c4bf54c89dd
Aug 11 07:20:43 dist-test-slave-7f01 krb5kdc[10103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432843, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.131@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:20:43.706015 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.697039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:57929 (local address 127.9.142.190:44139)
0811 07:20:43.697083 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.697086 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.697313 (+ 227us) server_negotiation.cc:407] Connection header received
0811 07:20:43.697837 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.697839 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.697867 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.697915 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:43.698912 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.699676 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.700691 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.700914 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.701002 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.703456 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:43.703457 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:43.703457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:43.703464 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:43.704875 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.705235 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.705236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.705236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.705288 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.705507 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.705508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.705508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.705606 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:43.705657 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.705889 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.705952 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 07:20:43.706205 11003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.697021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:44139 (local address 127.9.142.131:57929)
0811 07:20:43.697174 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:43.697210 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:43.697743 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:43.697976 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:43.697979 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:43.698525 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:43.698796 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.698802 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.699789 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.699790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.700579 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.700581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.701017 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.701018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.701145 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.701539 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:20:43.701547 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:43.703349 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:43.704949 (+ 1600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:43.704955 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:43.704957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:43.705169 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:43.705352 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:20:43.705353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:20:43.705353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:20:43.705453 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:20:43.705668 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:43.705672 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:43.705778 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 07:20:43.705861 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:20:43.705977 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260811 07:20:43.706722 11000 heartbeater.cc:347] Connected to a master server at 127.9.142.190:44139
I20260811 07:20:43.706828 11000 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:43.706975 11000 heartbeater.cc:511] Master 127.9.142.190:44139 requested a full tablet report, sending...
I20260811 07:20:43.707347 10207 ts_manager.cc:194] Registered new tserver with Master: e6b0ef8551244ed4b34ccb57068d13f8 (127.9.142.131:36779)
I20260811 07:20:43.707779 10207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.142.131@KRBTEST.COM'} at 127.9.142.131:57929
I20260811 07:20:43.710575 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:20:43.718145 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.711944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53466 (local address 127.9.142.190:44139)
0811 07:20:43.711983 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.711985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.712115 (+ 130us) server_negotiation.cc:407] Connection header received
0811 07:20:43.712189 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.712190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.712200 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.712249 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:43.712780 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.713235 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.713968 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.714244 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.714319 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.715478 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:43.715479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:43.715480 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:43.715487 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:43.716922 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.717295 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.717296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.717297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.717355 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:43.717586 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:43.717587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:43.717587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:43.717737 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:43.717839 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.717967 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.718046 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:20:43.719651 10207 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53466:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:20:43.721341 10207 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:20:43.727730 11019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.723539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:36779 (local address 127.0.0.1:53556)
0811 07:20:43.723826 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:43.723835 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:43.723879 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:43.724301 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:43.724304 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:43.724306 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:43.724375 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.724378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.725389 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.725390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.726462 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.726464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.727343 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.727344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.727477 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.727496 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 07:20:43.727587 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 07:20:43.727645 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":2,"thread_start_us":94,"threads_started":1}
I20260811 07:20:43.727926 11020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.723537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:43917 (local address 127.0.0.1:51830)
0811 07:20:43.723724 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:43.723792 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:43.723864 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:43.724345 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:43.724346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:43.724349 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:43.724414 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.724416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.725917 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.725918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.726707 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.726710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.727650 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.727651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.727723 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.727727 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:43.727805 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 07:20:43.727854 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":75,"threads_started":1}
I20260811 07:20:43.728034 11025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.723795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:35953 (local address 127.0.0.1:41370)
0811 07:20:43.723928 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:43.723937 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:43.723990 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:43.724480 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:43.724480 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:43.724482 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:43.724545 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.724546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.725882 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.725884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.726925 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.726928 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.727791 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.727792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.727882 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.727888 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:20:43.727936 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 07:20:43.727976 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":78,"threads_started":1}
I20260811 07:20:43.728092 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.723636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53556 (local address 127.9.142.131:36779)
0811 07:20:43.724108 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.724113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.724122 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:20:43.724160 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.724162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.724179 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.724459 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:43.724548 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.725265 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.726554 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.727250 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.727325 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.727380 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.727963 (+ 583us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.728004 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":90,"threads_started":1}
I20260811 07:20:43.728245 11029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.723764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51830 (local address 127.9.142.130:43917)
0811 07:20:43.724104 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.724109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.724120 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:20:43.724160 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.724162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.724178 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.724258 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:43.724707 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.725796 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.726831 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.727580 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.727647 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.727698 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.728077 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.728142 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":108,"threads_started":1}
I20260811 07:20:43.728328 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.724076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41370 (local address 127.9.142.129:35953)
0811 07:20:43.724242 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.724246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.724256 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:20:43.724298 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.724300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.724314 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.724396 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:43.724619 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.725764 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.727011 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.727621 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.727679 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.727732 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.728201 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.728240 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
I20260811 07:20:43.728792 10653 tablet_service.cc:1467] Processing CreateTablet for tablet 33762cf31c5e44eabed37b67ac48c0df (DEFAULT_TABLE table=test-table [id=45d6ed6af3ff4c8cabdd8f80a944cae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:43.728793 10887 tablet_service.cc:1467] Processing CreateTablet for tablet 33762cf31c5e44eabed37b67ac48c0df (DEFAULT_TABLE table=test-table [id=45d6ed6af3ff4c8cabdd8f80a944cae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:43.728967 10427 tablet_service.cc:1467] Processing CreateTablet for tablet 33762cf31c5e44eabed37b67ac48c0df (DEFAULT_TABLE table=test-table [id=45d6ed6af3ff4c8cabdd8f80a944cae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:43.729164 10653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33762cf31c5e44eabed37b67ac48c0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:43.729164 10887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33762cf31c5e44eabed37b67ac48c0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:43.729290 10427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33762cf31c5e44eabed37b67ac48c0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:43.732118 11031 tablet_bootstrap.cc:492] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c: Bootstrap starting.
I20260811 07:20:43.732719 11033 tablet_bootstrap.cc:492] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: Bootstrap starting.
I20260811 07:20:43.732890 11031 tablet_bootstrap.cc:654] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:43.733198 11032 tablet_bootstrap.cc:492] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: Bootstrap starting.
I20260811 07:20:43.733385 11033 tablet_bootstrap.cc:654] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:43.733510 11031 log.cc:824] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:43.733947 11032 tablet_bootstrap.cc:654] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:43.733975 11033 log.cc:824] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:43.734292 11031 tablet_bootstrap.cc:492] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c: No bootstrap required, opened a new log
I20260811 07:20:43.734380 11031 ts_tablet_manager.cc:1397] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:20:43.734563 11032 log.cc:824] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:43.734747 11033 tablet_bootstrap.cc:492] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: No bootstrap required, opened a new log
I20260811 07:20:43.734827 11033 ts_tablet_manager.cc:1397] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:20:43.735296 11032 tablet_bootstrap.cc:492] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: No bootstrap required, opened a new log
I20260811 07:20:43.735383 11032 ts_tablet_manager.cc:1397] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:20:43.736506 11031 raft_consensus.cc:348] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } }
I20260811 07:20:43.736703 11031 raft_consensus.cc:374] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:43.736742 11031 raft_consensus.cc:729] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1794ff3df7e64cd59208df8c357ee02c, State: Initialized, Role: FOLLOWER
I20260811 07:20:43.736893 11031 consensus_queue.cc:260] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } }
I20260811 07:20:43.736924 11032 raft_consensus.cc:348] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } }
I20260811 07:20:43.737100 11032 raft_consensus.cc:374] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:43.737149 11032 raft_consensus.cc:729] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b0ef8551244ed4b34ccb57068d13f8, State: Initialized, Role: FOLLOWER
I20260811 07:20:43.737183 11031 ts_tablet_manager.cc:1428] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:20:43.737182 11033 raft_consensus.cc:348] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } }
I20260811 07:20:43.737326 10539 heartbeater.cc:503] Master 127.9.142.190:44139 was elected leader, sending a full tablet report...
I20260811 07:20:43.737290 11032 consensus_queue.cc:260] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } }
I20260811 07:20:43.737346 11033 raft_consensus.cc:374] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:43.737390 11033 raft_consensus.cc:729] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3580e41ed26446f5ada0e5b68db96326, State: Initialized, Role: FOLLOWER
I20260811 07:20:43.737486 11033 consensus_queue.cc:260] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } }
I20260811 07:20:43.737571 11032 ts_tablet_manager.cc:1428] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:20:43.737622 11000 heartbeater.cc:503] Master 127.9.142.190:44139 was elected leader, sending a full tablet report...
I20260811 07:20:43.737749 11033 ts_tablet_manager.cc:1428] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:20:43.737876 10768 heartbeater.cc:503] Master 127.9.142.190:44139 was elected leader, sending a full tablet report...
W20260811 07:20:43.792783 10769 tablet.cc:2369] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:20:43.863348 10541 tablet.cc:2369] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:20:43.887642 11040 raft_consensus.cc:482] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:43.887850 11040 raft_consensus.cc:504] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } }
I20260811 07:20:43.888298 11040 leader_election.cc:288] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6b0ef8551244ed4b34ccb57068d13f8 (127.9.142.131:36779), 3580e41ed26446f5ada0e5b68db96326 (127.9.142.130:43917)
I20260811 07:20:43.892550 11029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.888694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:60633 (local address 127.9.142.130:43917)
0811 07:20:43.888744 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.888746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.888756 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:20:43.888825 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.888826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.888846 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.888947 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:43.889202 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.889973 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.891533 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.892159 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.892240 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.892250 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.892437 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.892477 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:20:43.892550 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.888618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:43627 (local address 127.9.142.131:36779)
0811 07:20:43.888673 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.888676 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.888879 (+ 203us) server_negotiation.cc:407] Connection header received
0811 07:20:43.888912 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.888914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.888925 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.888982 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:43.889202 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.889960 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.891534 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.892160 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.892241 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.892250 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.892437 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.892477 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 07:20:43.892637 11046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.888530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:43917 (local address 127.9.142.129:60633)
0811 07:20:43.888685 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:43.888697 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:43.888759 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:43.888990 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:43.888991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:43.888993 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:43.889120 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.889123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.890063 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.890065 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.891429 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.891432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.892254 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.892255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.892344 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.892353 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 07:20:43.892417 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 07:20:43.892481 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":71,"thread_start_us":84,"threads_started":1}
I20260811 07:20:43.892642 11047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.888539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:36779 (local address 127.9.142.129:43627)
0811 07:20:43.888801 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:43.888811 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:43.888873 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:43.888993 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:43.888994 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:43.888995 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:43.889126 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.889128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.890063 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.890065 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.891428 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:43.891432 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.892256 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.892256 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:43.892344 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.892351 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:20:43.892416 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 07:20:43.892481 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":107,"thread_start_us":83,"threads_started":1}
I20260811 07:20:43.893160 10686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33762cf31c5e44eabed37b67ac48c0df" candidate_uuid: "1794ff3df7e64cd59208df8c357ee02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3580e41ed26446f5ada0e5b68db96326" is_pre_election: true
I20260811 07:20:43.893205 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33762cf31c5e44eabed37b67ac48c0df" candidate_uuid: "1794ff3df7e64cd59208df8c357ee02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" is_pre_election: true
I20260811 07:20:43.893349 10686 raft_consensus.cc:2454] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1794ff3df7e64cd59208df8c357ee02c in term 0.
I20260811 07:20:43.893395 10915 raft_consensus.cc:2454] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1794ff3df7e64cd59208df8c357ee02c in term 0.
I20260811 07:20:43.893617 10357 leader_election.cc:302] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1794ff3df7e64cd59208df8c357ee02c, 3580e41ed26446f5ada0e5b68db96326; no voters:
I20260811 07:20:43.893790 11040 raft_consensus.cc:2781] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:20:43.893880 11040 raft_consensus.cc:482] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:20:43.893903 11040 raft_consensus.cc:3037] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:43.894645 11040 raft_consensus.cc:504] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } }
I20260811 07:20:43.894790 11040 leader_election.cc:288] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [CANDIDATE]: Term 1 election: Requested vote from peers e6b0ef8551244ed4b34ccb57068d13f8 (127.9.142.131:36779), 3580e41ed26446f5ada0e5b68db96326 (127.9.142.130:43917)
I20260811 07:20:43.894963 10686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33762cf31c5e44eabed37b67ac48c0df" candidate_uuid: "1794ff3df7e64cd59208df8c357ee02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3580e41ed26446f5ada0e5b68db96326"
I20260811 07:20:43.894973 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33762cf31c5e44eabed37b67ac48c0df" candidate_uuid: "1794ff3df7e64cd59208df8c357ee02c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b0ef8551244ed4b34ccb57068d13f8"
I20260811 07:20:43.895051 10915 raft_consensus.cc:3037] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:43.895061 10686 raft_consensus.cc:3037] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:43.895875 10686 raft_consensus.cc:2454] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1794ff3df7e64cd59208df8c357ee02c in term 1.
I20260811 07:20:43.896008 10915 raft_consensus.cc:2454] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1794ff3df7e64cd59208df8c357ee02c in term 1.
I20260811 07:20:43.896195 10352 leader_election.cc:302] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1794ff3df7e64cd59208df8c357ee02c, e6b0ef8551244ed4b34ccb57068d13f8; no voters:
I20260811 07:20:43.896292 11040 raft_consensus.cc:2781] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:43.896450 11040 raft_consensus.cc:686] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [term 1 LEADER]: Becoming Leader. State: Replica: 1794ff3df7e64cd59208df8c357ee02c, State: Running, Role: LEADER
I20260811 07:20:43.896564 11040 consensus_queue.cc:237] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } }
I20260811 07:20:43.897509 10207 catalog_manager.cc:5495] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1794ff3df7e64cd59208df8c357ee02c (127.9.142.129). New cstate: current_term: 1 leader_uuid: "1794ff3df7e64cd59208df8c357ee02c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1794ff3df7e64cd59208df8c357ee02c" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 35953 } health_report { overall_health: HEALTHY } } }
I20260811 07:20:43.907959 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.905657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41376 (local address 127.9.142.129:35953)
0811 07:20:43.905711 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:43.905713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:43.905722 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:20:43.905768 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:43.905769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:43.905784 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:43.905858 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:20:43.905988 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.906455 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.907199 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:43.907391 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:43.907458 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:43.907601 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:20:43.907697 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:20:43.907805 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:43.907871 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 07:20:43.907898 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 07:20:43.909852 10915 raft_consensus.cc:1261] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [term 1 FOLLOWER]: Refusing update from remote peer 1794ff3df7e64cd59208df8c357ee02c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:43.910204 10686 raft_consensus.cc:1261] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [term 1 FOLLOWER]: Refusing update from remote peer 1794ff3df7e64cd59208df8c357ee02c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:43.910244 11051 consensus_queue.cc:1035] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b0ef8551244ed4b34ccb57068d13f8" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:43.910667 11051 consensus_queue.cc:1035] T 33762cf31c5e44eabed37b67ac48c0df P 1794ff3df7e64cd59208df8c357ee02c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3580e41ed26446f5ada0e5b68db96326" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:43.913350 11060 mvcc.cc:205] Tried to move back new op lower bound from 7317228928651669504 to 7317228928601112576. Current Snapshot: MvccSnapshot[applied={T|T < 7317228928651669504}]
I20260811 07:20:43.913715 11058 mvcc.cc:205] Tried to move back new op lower bound from 7317228928651669504 to 7317228928601112576. Current Snapshot: MvccSnapshot[applied={T|T < 7317228928651669504 or (T in {7317228928651669504})}]
I20260811 07:20:43.916146 10207 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:43.916261 10207 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:43.917078 10207 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bceb0d5efeb54ad7853585b44b2323d5: Sending DeleteTablet for 3 replicas of tablet 33762cf31c5e44eabed37b67ac48c0df
I20260811 07:20:43.917488 10653 tablet_service.cc:1514] Processing DeleteTablet for tablet 33762cf31c5e44eabed37b67ac48c0df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:43 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:51830
I20260811 07:20:43.917510 10887 tablet_service.cc:1514] Processing DeleteTablet for tablet 33762cf31c5e44eabed37b67ac48c0df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:43 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:53556
I20260811 07:20:43.917747 10427 tablet_service.cc:1514] Processing DeleteTablet for tablet 33762cf31c5e44eabed37b67ac48c0df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:43 UTC) from {username='kudu', principal='kudu/127.9.142.190@KRBTEST.COM'} at 127.0.0.1:41370
I20260811 07:20:43.918156 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 10322
I20260811 07:20:43.923767 11081 tablet_replica.cc:330] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: stopping tablet replica
I20260811 07:20:43.923974 11081 raft_consensus.cc:2229] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:43.924201 11081 raft_consensus.cc:2258] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:43.925742 11076 tablet_replica.cc:330] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: stopping tablet replica
I20260811 07:20:43.925895 11076 raft_consensus.cc:2229] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:43.926018 11076 raft_consensus.cc:2258] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:43.926023 11081 ts_tablet_manager.cc:1905] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:43.928980 11081 ts_tablet_manager.cc:1918] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:43.929092 11081 log.cc:1196] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/33762cf31c5e44eabed37b67ac48c0df
I20260811 07:20:43.929432 11081 ts_tablet_manager.cc:1939] T 33762cf31c5e44eabed37b67ac48c0df P e6b0ef8551244ed4b34ccb57068d13f8: Deleting consensus metadata
I20260811 07:20:43.930567 10170 catalog_manager.cc:4841] TS e6b0ef8551244ed4b34ccb57068d13f8 (127.9.142.131:36779): tablet 33762cf31c5e44eabed37b67ac48c0df (table test-table [id=45d6ed6af3ff4c8cabdd8f80a944cae4]) successfully deleted
I20260811 07:20:43.931424 11076 ts_tablet_manager.cc:1905] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:43.932809 11076 ts_tablet_manager.cc:1918] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:43.932914 11076 log.cc:1196] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/33762cf31c5e44eabed37b67ac48c0df
I20260811 07:20:43.933173 11076 ts_tablet_manager.cc:1939] T 33762cf31c5e44eabed37b67ac48c0df P 3580e41ed26446f5ada0e5b68db96326: Deleting consensus metadata
I20260811 07:20:43.933657 10175 catalog_manager.cc:4841] TS 3580e41ed26446f5ada0e5b68db96326 (127.9.142.130:43917): tablet 33762cf31c5e44eabed37b67ac48c0df (table test-table [id=45d6ed6af3ff4c8cabdd8f80a944cae4]) successfully deleted
W20260811 07:20:43.935817 10172 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:35953 (error 108)
I20260811 07:20:43.936367 11020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:43.936238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:35953 (local address 127.0.0.1:41384)
0811 07:20:43.936298 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:43.936336 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:35953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 07:20:43.936460 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 10547
W20260811 07:20:43.936508 10172 catalog_manager.cc:4584] TS 1794ff3df7e64cd59208df8c357ee02c (127.9.142.129:35953): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 33762cf31c5e44eabed37b67ac48c0df: Network error: Client connection negotiation failed: client connection to 127.9.142.129:35953: connect: Connection refused (error 111)
I20260811 07:20:43.949237 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 10777
I20260811 07:20:43.965154 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 10143
2026-08-11T07:20:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2436 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T07:20:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:43Z Disabled control of system clock
I20260811 07:20:44.002516 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41141
--webserver_interface=127.9.142.190
--webserver_port=0
--builtin_ntp_servers=127.9.142.148:35517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:41141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:44.088763 11094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:44.088981 11094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:44.089002 11094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:44.090081 11094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:44.090117 11094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:44.090130 11094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:44.090142 11094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:44.090154 11094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:44.091434 11094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:41141
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:44.091630 11094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:44.091897 11094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:44.096849 11107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:44.096879 11104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:44.097038 11101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:44.097282 11094 server_base.cc:1034] running on GCE node
I20260811 07:20:44.097708 11094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:44.098047 11094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:44.099244 11094 hybrid_clock.cc:648] HybridClock initialized: now 1786432844099225 us; error 46 us; skew 500 ppm
I20260811 07:20:44.100696 11094 webserver.cc:460] Webserver started at http://127.9.142.190:41831/ using document root <none> and password file <none>
I20260811 07:20:44.100989 11094 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:44.101042 11094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:44.101203 11094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:44.102284 11094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "640e2fd20b1043eeb0166124fcf1bc5c"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "f1d6dd8666d1f3c8855894e5b7f39747"
server_key_iv: "2f3b0a5a33410cd2ffc1ff8a5aa3c7d1"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.102669 11094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "640e2fd20b1043eeb0166124fcf1bc5c"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "f1d6dd8666d1f3c8855894e5b7f39747"
server_key_iv: "2f3b0a5a33410cd2ffc1ff8a5aa3c7d1"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.104108 11094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:20:44.105036 11116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.105295 11094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:20:44.105415 11094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "640e2fd20b1043eeb0166124fcf1bc5c"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "f1d6dd8666d1f3c8855894e5b7f39747"
server_key_iv: "2f3b0a5a33410cd2ffc1ff8a5aa3c7d1"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.105518 11094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:44.132131 11094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:44.132520 11094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:44.132694 11094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:44.136963 11094 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:41141
I20260811 07:20:44.136999 11220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:41141 every 8 connection(s)
I20260811 07:20:44.137405 11094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:44.137669 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 11094
I20260811 07:20:44.137794 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:44.138008 9786 external_mini_cluster.cc:1428] Setting key dbfcf7ac4cfbd9e2af72becf9dd9bd6d
I20260811 07:20:44.138598 11222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:44.141394 11222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c: Bootstrap starting.
I20260811 07:20:44.142028 11222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:44.142370 11222 log.cc:824] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:44.143261 11222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c: No bootstrap required, opened a new log
I20260811 07:20:44.143821 11229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.138604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42404 (local address 127.9.142.190:41141)
0811 07:20:44.138826 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.138833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.138859 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:20:44.139302 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.139309 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.139368 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.139562 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:44.139815 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.140709 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.141552 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.141949 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.142116 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.142959 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:44.142964 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:44.142964 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:44.143176 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:44.143218 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:44.143233 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:44.143314 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.143500 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.143589 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":98,"threads_started":1}
I20260811 07:20:44.145531 11222 raft_consensus.cc:348] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640e2fd20b1043eeb0166124fcf1bc5c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41141 } }
I20260811 07:20:44.145668 11222 raft_consensus.cc:374] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:44.145691 11222 raft_consensus.cc:729] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640e2fd20b1043eeb0166124fcf1bc5c, State: Initialized, Role: FOLLOWER
I20260811 07:20:44.145828 11222 consensus_queue.cc:260] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640e2fd20b1043eeb0166124fcf1bc5c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41141 } }
I20260811 07:20:44.145906 11222 raft_consensus.cc:388] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:44.145951 11222 raft_consensus.cc:482] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:44.146001 11222 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:44.146541 11222 raft_consensus.cc:504] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640e2fd20b1043eeb0166124fcf1bc5c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41141 } }
I20260811 07:20:44.146636 11222 leader_election.cc:302] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 640e2fd20b1043eeb0166124fcf1bc5c; no voters:
I20260811 07:20:44.146842 11222 leader_election.cc:288] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:44.146941 11232 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:44.147091 11232 raft_consensus.cc:686] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [term 1 LEADER]: Becoming Leader. State: Replica: 640e2fd20b1043eeb0166124fcf1bc5c, State: Running, Role: LEADER
I20260811 07:20:44.147120 11222 sys_catalog.cc:564] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:44.147228 11232 consensus_queue.cc:237] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640e2fd20b1043eeb0166124fcf1bc5c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41141 } }
I20260811 07:20:44.147629 11234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "640e2fd20b1043eeb0166124fcf1bc5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640e2fd20b1043eeb0166124fcf1bc5c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41141 } } }
I20260811 07:20:44.147647 11236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 640e2fd20b1043eeb0166124fcf1bc5c. Latest consensus state: current_term: 1 leader_uuid: "640e2fd20b1043eeb0166124fcf1bc5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640e2fd20b1043eeb0166124fcf1bc5c" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41141 } } }
I20260811 07:20:44.147837 11236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:44.148077 11245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:44.148085 11234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:44.148649 11245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:44.150293 11245 catalog_manager.cc:1347] Generated new cluster ID: 89930aa4d2d84d07bbc01948c1488165
I20260811 07:20:44.150362 11245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:44.165769 11245 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:44.166527 11245 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:44.176667 11245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c: Generated new TSK 0
I20260811 07:20:44.176868 11245 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:44.183305 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.129:0
--local_ip_for_outbound_sockets=127.9.142.129
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41141
--builtin_ntp_servers=127.9.142.148:35517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:44.272637 11270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:44.272866 11270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:44.272900 11270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:44.274031 11270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:44.274094 11270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:44.274138 11270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.129
I20260811 07:20:44.275467 11270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.142.129
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.129
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:44.275717 11270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:44.276029 11270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:44.281778 11280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:44.281785 11279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:44.282166 11284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:44.282266 11270 server_base.cc:1034] running on GCE node
I20260811 07:20:44.282538 11270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:44.282790 11270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:44.283962 11270 hybrid_clock.cc:648] HybridClock initialized: now 1786432844283949 us; error 27 us; skew 500 ppm
I20260811 07:20:44.285220 11270 webserver.cc:460] Webserver started at http://127.9.142.129:32857/ using document root <none> and password file <none>
I20260811 07:20:44.285480 11270 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:44.285527 11270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:44.285683 11270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:44.286737 11270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/data/instance:
uuid: "dec94ba237374d0ea529cce9572a5603"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "132550051b3fd2e906dc664e7ffc7542"
server_key_iv: "b2a5c7ee318b5203e7038fc17a4807ae"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.287122 11270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance:
uuid: "dec94ba237374d0ea529cce9572a5603"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "132550051b3fd2e906dc664e7ffc7542"
server_key_iv: "b2a5c7ee318b5203e7038fc17a4807ae"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.288483 11270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:20:44.289186 11292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.289371 11270 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:20:44.289470 11270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/wal
uuid: "dec94ba237374d0ea529cce9572a5603"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "132550051b3fd2e906dc664e7ffc7542"
server_key_iv: "b2a5c7ee318b5203e7038fc17a4807ae"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.289539 11270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:44.303787 11270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:44.304078 11270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:44.304222 11270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:44.304446 11270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:44.304769 11270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:44.304803 11270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.304848 11270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:44.304875 11270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.310877 11270 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.129:43611
I20260811 07:20:44.310935 11503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.129:43611 every 8 connection(s)
I20260811 07:20:44.311281 11270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/data/info.pb
I20260811 07:20:44.316318 11229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.312150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.129:41043 (local address 127.9.142.190:41141)
0811 07:20:44.312235 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.312237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.312442 (+ 205us) server_negotiation.cc:407] Connection header received
0811 07:20:44.312925 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.312927 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.312942 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.312997 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:44.313637 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.314124 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.315056 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.315239 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.315289 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.316074 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:44.316075 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:44.316075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:44.316079 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:44.316093 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:44.316097 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:44.316140 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.316224 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.316258 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:20:44.316489 11508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.312104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41141 (local address 127.9.142.129:41043)
0811 07:20:44.312319 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.312354 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:44.312840 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:44.313060 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:44.313064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:44.313072 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:44.313564 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.313568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.314206 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.314206 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.314981 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.314983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.315315 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.315316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.315429 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.315943 (+ 514us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:20:44.315943 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:44.315971 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:20:44.315994 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:44.316154 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:44.316159 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:44.316161 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:20:44.316213 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 07:20:44.316291 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":109,"threads_started":1}
I20260811 07:20:44.317034 11504 heartbeater.cc:347] Connected to a master server at 127.9.142.190:41141
I20260811 07:20:44.317129 11504 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:44.317320 11504 heartbeater.cc:511] Master 127.9.142.190:41141 requested a full tablet report, sending...
I20260811 07:20:44.317847 11144 ts_manager.cc:194] Registered new tserver with Master: dec94ba237374d0ea529cce9572a5603 (127.9.142.129:43611)
I20260811 07:20:44.318464 11144 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.129:41043
I20260811 07:20:44.319887 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 11270
I20260811 07:20:44.319976 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-0/wal/instance
I20260811 07:20:44.320124 9786 external_mini_cluster.cc:1428] Setting key 390f7a2f3115f8c32cf64c6455d65f68
I20260811 07:20:44.320987 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.130:0
--local_ip_for_outbound_sockets=127.9.142.130
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41141
--builtin_ntp_servers=127.9.142.148:35517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:44.406155 11510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:44.406486 11510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:44.406523 11510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:44.408113 11510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:44.408151 11510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:44.408177 11510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.130
I20260811 07:20:44.409555 11510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.142.130
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.130
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:44.409747 11510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:44.410022 11510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:44.414994 11518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:44.415062 11520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:44.415354 11510 server_base.cc:1034] running on GCE node
W20260811 07:20:44.415004 11522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:44.415700 11510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:44.416015 11510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:44.417167 11510 hybrid_clock.cc:648] HybridClock initialized: now 1786432844417150 us; error 45 us; skew 500 ppm
I20260811 07:20:44.418495 11510 webserver.cc:460] Webserver started at http://127.9.142.130:46521/ using document root <none> and password file <none>
I20260811 07:20:44.418744 11510 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:44.418793 11510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:44.418937 11510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:44.420099 11510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/data/instance:
uuid: "085f95dea5c040c9bac4c803a278d8a5"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "faf69f7230115125ce1c779e3f3892b5"
server_key_iv: "cc02b7fbc4ad1e0e10a08c3644b1d6cf"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.420454 11510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance:
uuid: "085f95dea5c040c9bac4c803a278d8a5"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "faf69f7230115125ce1c779e3f3892b5"
server_key_iv: "cc02b7fbc4ad1e0e10a08c3644b1d6cf"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.421737 11510 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:20:44.422461 11531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.422639 11510 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:20:44.422750 11510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/wal
uuid: "085f95dea5c040c9bac4c803a278d8a5"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "faf69f7230115125ce1c779e3f3892b5"
server_key_iv: "cc02b7fbc4ad1e0e10a08c3644b1d6cf"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.422823 11510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:44.442394 11510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:44.442698 11510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:44.442842 11510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:44.443077 11510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:44.443432 11510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:44.443490 11510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.443526 11510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:44.443552 11510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.449868 11510 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.130:46449
I20260811 07:20:44.449920 11741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.130:46449 every 8 connection(s)
I20260811 07:20:44.450284 11510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/data/info.pb
I20260811 07:20:44.455222 11229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.451070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.130:47915 (local address 127.9.142.190:41141)
0811 07:20:44.451137 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.451141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.451375 (+ 234us) server_negotiation.cc:407] Connection header received
0811 07:20:44.451864 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.451865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.451875 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.451932 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:44.452567 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.453047 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.453983 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.454170 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.454220 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.454986 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:44.454988 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:44.454988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:44.454992 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:44.455007 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:44.455010 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:44.455053 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.455136 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.455158 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 07:20:44.455407 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.451030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41141 (local address 127.9.142.130:47915)
0811 07:20:44.451232 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.451273 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:44.451779 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:44.451993 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:44.451997 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:44.452005 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:44.452496 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.452501 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.453126 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.453127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.453908 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.453910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.454250 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.454251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.454369 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.454857 (+ 488us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:20:44.454857 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:44.454885 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:20:44.454906 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:44.455066 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:44.455071 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:44.455073 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 07:20:44.455124 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 07:20:44.455201 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":108,"threads_started":1}
I20260811 07:20:44.455986 11742 heartbeater.cc:347] Connected to a master server at 127.9.142.190:41141
I20260811 07:20:44.456090 11742 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:44.456270 11742 heartbeater.cc:511] Master 127.9.142.190:41141 requested a full tablet report, sending...
I20260811 07:20:44.456672 11144 ts_manager.cc:194] Registered new tserver with Master: 085f95dea5c040c9bac4c803a278d8a5 (127.9.142.130:46449)
I20260811 07:20:44.457103 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 11510
I20260811 07:20:44.457216 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/wal/instance
I20260811 07:20:44.457195 11144 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.130:47915
I20260811 07:20:44.457443 9786 external_mini_cluster.cc:1428] Setting key d0dcb5581a3b7b0fe4365db41512b89f
I20260811 07:20:44.458371 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.142.131:0
--local_ip_for_outbound_sockets=127.9.142.131
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41141
--builtin_ntp_servers=127.9.142.148:35517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:20:44.542647 11745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:44.542862 11745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:44.542886 11745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:44.544059 11745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:44.544099 11745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:44.544126 11745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.142.131
I20260811 07:20:44.545454 11745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:35517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.142.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.142.131
--webserver_port=0
--tserver_master_addrs=127.9.142.190:41141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.142.131
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:44.545696 11745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:44.546001 11745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:44.551569 11754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:44.551573 11759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:44.551566 11755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:44.551606 11745 server_base.cc:1034] running on GCE node
I20260811 07:20:44.552074 11745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:44.552369 11745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:44.553534 11745 hybrid_clock.cc:648] HybridClock initialized: now 1786432844553526 us; error 35 us; skew 500 ppm
I20260811 07:20:44.554862 11745 webserver.cc:460] Webserver started at http://127.9.142.131:45993/ using document root <none> and password file <none>
I20260811 07:20:44.555130 11745 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:44.555179 11745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:44.555333 11745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:44.556489 11745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/data/instance:
uuid: "63af0eab427548a2b3549da6841ca4dd"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "09ebd4a14f62f18b36cccc1b54008bcd"
server_key_iv: "48df5b6c955a30f906d94bde328bab2f"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.556857 11745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance:
uuid: "63af0eab427548a2b3549da6841ca4dd"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "09ebd4a14f62f18b36cccc1b54008bcd"
server_key_iv: "48df5b6c955a30f906d94bde328bab2f"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.558210 11745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 07:20:44.559017 11767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.559196 11745 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:20:44.559302 11745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/wal
uuid: "63af0eab427548a2b3549da6841ca4dd"
format_stamp: "Formatted at 2026-08-11 07:20:44 on dist-test-slave-7f01"
server_key: "09ebd4a14f62f18b36cccc1b54008bcd"
server_key_iv: "48df5b6c955a30f906d94bde328bab2f"
server_key_version: "encryptionkey@0"
I20260811 07:20:44.559384 11745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:44.569023 11745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:44.569314 11745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:44.569456 11745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:44.569679 11745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:20:44.570042 11745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:20:44.570098 11745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.570140 11745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:20:44.570165 11745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:44.576340 11745 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.131:41719
I20260811 07:20:44.576426 11985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.131:41719 every 8 connection(s)
I20260811 07:20:44.576752 11745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/data/info.pb
I20260811 07:20:44.582290 11229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.577720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:42521 (local address 127.9.142.190:41141)
0811 07:20:44.577775 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.577777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.578094 (+ 317us) server_negotiation.cc:407] Connection header received
0811 07:20:44.578595 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.578596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.578607 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.578662 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:44.579348 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.579865 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.580862 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.581058 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.581112 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.582000 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:44.582001 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:44.582001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:44.582012 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:44.582026 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:44.582030 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:44.582074 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.582204 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.582226 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:20:44.582634 11990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.577718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:41141 (local address 127.9.142.131:42521)
0811 07:20:44.577966 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.578001 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:44.578509 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:44.578727 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:44.578730 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:44.578738 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:20:44.579260 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.579265 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.579972 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.579973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.580763 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.580767 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.581161 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.581162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.581288 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.581842 (+ 554us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:20:44.581843 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:20:44.581891 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:20:44.581915 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:20:44.582116 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:20:44.582123 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:20:44.582126 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:20:44.582194 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 07:20:44.582279 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":100,"threads_started":1}
I20260811 07:20:44.583153 11986 heartbeater.cc:347] Connected to a master server at 127.9.142.190:41141
I20260811 07:20:44.583240 11986 heartbeater.cc:464] Registering TS with master...
I20260811 07:20:44.583455 11986 heartbeater.cc:511] Master 127.9.142.190:41141 requested a full tablet report, sending...
I20260811 07:20:44.583946 11144 ts_manager.cc:194] Registered new tserver with Master: 63af0eab427548a2b3549da6841ca4dd (127.9.142.131:41719)
I20260811 07:20:44.584100 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 11745
I20260811 07:20:44.584203 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/wal/instance
I20260811 07:20:44.584429 9786 external_mini_cluster.cc:1428] Setting key 23c1fe8b6548dba11ce6e6317e2aa1e7
I20260811 07:20:44.584474 11144 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.142.131:42521
I20260811 07:20:44.585496 9786 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:20:44.589661 11229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.586919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42414 (local address 127.9.142.190:41141)
0811 07:20:44.586959 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.586961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.587089 (+ 128us) server_negotiation.cc:407] Connection header received
0811 07:20:44.587143 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.587143 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.587151 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.587197 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:44.587320 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.587830 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.588572 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.588746 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.588800 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.589473 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:44.589474 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:44.589475 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:44.589479 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:44.589490 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:44.589493 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:44.589536 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.589591 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.589608 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:20:44.591161 11144 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:20:44.592917 11144 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:20:44.599277 11998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.595055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.131:41719 (local address 127.0.0.1:50144)
0811 07:20:44.595224 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.595263 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:44.595330 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:44.595951 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:44.595952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:44.595954 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:44.595998 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.595999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.596902 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.596903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.598117 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.598119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.599057 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.599058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.599109 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.599112 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:20:44.599154 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 07:20:44.599186 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":58,"threads_started":1}
I20260811 07:20:44.599334 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.595128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50144 (local address 127.9.142.131:41719)
0811 07:20:44.595783 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.595787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.595797 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:20:44.595833 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.595835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.595850 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.596077 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:44.596136 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.596802 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.598207 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.598979 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.599058 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.599155 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.599182 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.599220 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":88,"threads_started":1}
I20260811 07:20:44.599392 11999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.595088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:43611 (local address 127.0.0.1:42948)
0811 07:20:44.595442 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.595452 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:44.595501 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:44.595780 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:44.595783 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:44.595786 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:44.595853 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.595855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.597261 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.597262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.598285 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.598287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.599172 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.599173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.599235 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.599239 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:44.599271 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 07:20:44.599310 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":96,"threads_started":1}
I20260811 07:20:44.599193 12002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.595088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:46449 (local address 127.0.0.1:59894)
0811 07:20:44.595582 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.595590 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:44.595633 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:44.595992 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:44.595993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:44.595996 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:44.596055 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.596057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.597326 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.597328 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.598206 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.598209 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.598888 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.598890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.598963 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.598976 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 07:20:44.599050 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 07:20:44.599100 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":2,"thread_start_us":97,"threads_started":1}
I20260811 07:20:44.599382 12007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.595559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59894 (local address 127.9.142.130:46449)
0811 07:20:44.595812 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.595817 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.595828 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:20:44.595870 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.595872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.595888 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.596135 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:44.596203 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.597266 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.598285 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.598799 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.598888 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.598984 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.599244 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.599283 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":94,"threads_started":1}
I20260811 07:20:44.600273 12006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.595335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42948 (local address 127.9.142.129:43611)
0811 07:20:44.595540 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.595544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.595555 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:20:44.595590 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.595592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.595604 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.595960 (+ 356us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:44.596027 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.597165 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.598355 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.599067 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.600018 (+ 951us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.600117 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.600145 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.600192 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":107,"threads_started":1}
I20260811 07:20:44.600163 11863 tablet_service.cc:1467] Processing CreateTablet for tablet 748cb334bbc14da383769c17b5882af3 (DEFAULT_TABLE table=test-table [id=b17d023144b14efba404791e95c52c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:44.600224 11624 tablet_service.cc:1467] Processing CreateTablet for tablet 748cb334bbc14da383769c17b5882af3 (DEFAULT_TABLE table=test-table [id=b17d023144b14efba404791e95c52c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:44.600600 11624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 748cb334bbc14da383769c17b5882af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:44.600596 11863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 748cb334bbc14da383769c17b5882af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:44.600886 11374 tablet_service.cc:1467] Processing CreateTablet for tablet 748cb334bbc14da383769c17b5882af3 (DEFAULT_TABLE table=test-table [id=b17d023144b14efba404791e95c52c30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:20:44.601214 11374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 748cb334bbc14da383769c17b5882af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:44.603320 12012 tablet_bootstrap.cc:492] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: Bootstrap starting.
I20260811 07:20:44.604240 12012 tablet_bootstrap.cc:654] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:44.604553 12012 log.cc:824] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:44.604621 12015 tablet_bootstrap.cc:492] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603: Bootstrap starting.
I20260811 07:20:44.604928 12014 tablet_bootstrap.cc:492] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: Bootstrap starting.
I20260811 07:20:44.605336 12012 tablet_bootstrap.cc:492] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: No bootstrap required, opened a new log
I20260811 07:20:44.605423 12012 ts_tablet_manager.cc:1397] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:20:44.605443 12015 tablet_bootstrap.cc:654] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:44.605582 12014 tablet_bootstrap.cc:654] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:44.605798 12015 log.cc:824] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:44.605931 12014 log.cc:824] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:44.606801 12014 tablet_bootstrap.cc:492] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: No bootstrap required, opened a new log
I20260811 07:20:44.606877 12014 ts_tablet_manager.cc:1397] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:20:44.608222 12015 tablet_bootstrap.cc:492] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603: No bootstrap required, opened a new log
I20260811 07:20:44.608139 12012 raft_consensus.cc:348] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } }
I20260811 07:20:44.608323 12015 ts_tablet_manager.cc:1397] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 07:20:44.608318 12012 raft_consensus.cc:374] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:44.608358 12012 raft_consensus.cc:729] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 085f95dea5c040c9bac4c803a278d8a5, State: Initialized, Role: FOLLOWER
I20260811 07:20:44.608494 12012 consensus_queue.cc:260] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } }
I20260811 07:20:44.608772 12012 ts_tablet_manager.cc:1428] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260811 07:20:44.608903 11742 heartbeater.cc:503] Master 127.9.142.190:41141 was elected leader, sending a full tablet report...
I20260811 07:20:44.609503 12014 raft_consensus.cc:348] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } }
I20260811 07:20:44.609619 12014 raft_consensus.cc:374] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:44.609679 12014 raft_consensus.cc:729] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63af0eab427548a2b3549da6841ca4dd, State: Initialized, Role: FOLLOWER
I20260811 07:20:44.609781 12014 consensus_queue.cc:260] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } }
I20260811 07:20:44.610054 12014 ts_tablet_manager.cc:1428] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 07:20:44.610282 11986 heartbeater.cc:503] Master 127.9.142.190:41141 was elected leader, sending a full tablet report...
I20260811 07:20:44.611033 12015 raft_consensus.cc:348] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } }
I20260811 07:20:44.611177 12015 raft_consensus.cc:374] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:44.611222 12015 raft_consensus.cc:729] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec94ba237374d0ea529cce9572a5603, State: Initialized, Role: FOLLOWER
I20260811 07:20:44.611330 12015 consensus_queue.cc:260] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } }
I20260811 07:20:44.611596 12015 ts_tablet_manager.cc:1428] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 07:20:44.611701 11504 heartbeater.cc:503] Master 127.9.142.190:41141 was elected leader, sending a full tablet report...
I20260811 07:20:44.681548 12024 raft_consensus.cc:482] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:20:44.681689 12024 raft_consensus.cc:504] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } }
I20260811 07:20:44.682094 12024 leader_election.cc:288] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 085f95dea5c040c9bac4c803a278d8a5 (127.9.142.130:46449), dec94ba237374d0ea529cce9572a5603 (127.9.142.129:43611)
I20260811 07:20:44.685070 12007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.682419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:44211 (local address 127.9.142.130:46449)
0811 07:20:44.682466 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.682468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.682479 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:20:44.682516 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.682517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.682526 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.682605 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:44.682815 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.683311 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.684334 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.684699 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.684803 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.684813 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.684962 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.685000 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:20:44.685070 11990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.682302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:46449 (local address 127.9.142.131:44211)
0811 07:20:44.682385 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.682399 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:44.682456 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:44.682611 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:44.682612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:44.682614 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:44.682710 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.682712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.683403 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.683404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.684231 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.684233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.684803 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.684805 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.684873 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.684877 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:20:44.684952 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 07:20:44.684997 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 07:20:44.685174 12006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.682398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.142.131:50671 (local address 127.9.142.129:43611)
0811 07:20:44.682449 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.682451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.682604 (+ 153us) server_negotiation.cc:407] Connection header received
0811 07:20:44.682686 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.682687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.682699 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.682770 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:20:44.682937 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.683403 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.684436 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.684807 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.684898 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.684907 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.685071 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.685110 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 07:20:44.685191 12029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.682303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:43611 (local address 127.9.142.131:50671)
0811 07:20:44.682526 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.682535 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:20:44.682618 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:20:44.682776 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:20:44.682777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:20:44.682778 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:20:44.682864 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.682866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.683492 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.683493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.684339 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:20:44.684342 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.684899 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.684900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:20:44.684974 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.684977 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:20:44.685062 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:20:44.685099 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":42,"thread_start_us":105,"threads_started":1}
I20260811 07:20:44.685581 11419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748cb334bbc14da383769c17b5882af3" candidate_uuid: "63af0eab427548a2b3549da6841ca4dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec94ba237374d0ea529cce9572a5603" is_pre_election: true
I20260811 07:20:44.685672 11657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748cb334bbc14da383769c17b5882af3" candidate_uuid: "63af0eab427548a2b3549da6841ca4dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "085f95dea5c040c9bac4c803a278d8a5" is_pre_election: true
I20260811 07:20:44.685822 11419 raft_consensus.cc:2454] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63af0eab427548a2b3549da6841ca4dd in term 0.
I20260811 07:20:44.685904 11657 raft_consensus.cc:2454] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63af0eab427548a2b3549da6841ca4dd in term 0.
I20260811 07:20:44.686086 11771 leader_election.cc:302] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63af0eab427548a2b3549da6841ca4dd, dec94ba237374d0ea529cce9572a5603; no voters:
I20260811 07:20:44.686272 12024 raft_consensus.cc:2781] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:20:44.686372 12024 raft_consensus.cc:482] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:20:44.686417 12024 raft_consensus.cc:3037] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:44.687260 12024 raft_consensus.cc:504] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } }
I20260811 07:20:44.687516 12024 leader_election.cc:288] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [CANDIDATE]: Term 1 election: Requested vote from peers 085f95dea5c040c9bac4c803a278d8a5 (127.9.142.130:46449), dec94ba237374d0ea529cce9572a5603 (127.9.142.129:43611)
I20260811 07:20:44.687762 11657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748cb334bbc14da383769c17b5882af3" candidate_uuid: "63af0eab427548a2b3549da6841ca4dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "085f95dea5c040c9bac4c803a278d8a5"
I20260811 07:20:44.687731 11419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748cb334bbc14da383769c17b5882af3" candidate_uuid: "63af0eab427548a2b3549da6841ca4dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec94ba237374d0ea529cce9572a5603"
I20260811 07:20:44.687845 11657 raft_consensus.cc:3037] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:44.687885 11419 raft_consensus.cc:3037] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:44.688982 11657 raft_consensus.cc:2454] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63af0eab427548a2b3549da6841ca4dd in term 1.
I20260811 07:20:44.688982 11419 raft_consensus.cc:2454] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63af0eab427548a2b3549da6841ca4dd in term 1.
I20260811 07:20:44.689182 11771 leader_election.cc:302] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63af0eab427548a2b3549da6841ca4dd, dec94ba237374d0ea529cce9572a5603; no voters:
I20260811 07:20:44.689313 12024 raft_consensus.cc:2781] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:44.689519 12024 raft_consensus.cc:686] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 1 LEADER]: Becoming Leader. State: Replica: 63af0eab427548a2b3549da6841ca4dd, State: Running, Role: LEADER
I20260811 07:20:44.689606 12024 consensus_queue.cc:237] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } }
I20260811 07:20:44.690629 11144 catalog_manager.cc:5495] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 63af0eab427548a2b3549da6841ca4dd (127.9.142.131). New cstate: current_term: 1 leader_uuid: "63af0eab427548a2b3549da6841ca4dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63af0eab427548a2b3549da6841ca4dd" member_type: VOTER last_known_addr { host: "127.9.142.131" port: 41719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 } health_report { overall_health: UNKNOWN } } }
W20260811 07:20:44.700831 11743 tablet.cc:2369] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:20:44.719256 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.716603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50156 (local address 127.9.142.131:41719)
0811 07:20:44.716677 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:44.716679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:44.716707 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:20:44.716749 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:44.716750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:44.716770 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:44.716841 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:20:44.716961 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.717488 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.718408 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:44.718608 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:44.718670 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:44.718842 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:20:44.718962 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:20:44.719027 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:44.719091 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 07:20:44.719112 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:20:44.721522 11657 raft_consensus.cc:1261] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [term 1 FOLLOWER]: Refusing update from remote peer 63af0eab427548a2b3549da6841ca4dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:44.721551 11419 raft_consensus.cc:1261] T 748cb334bbc14da383769c17b5882af3 P dec94ba237374d0ea529cce9572a5603 [term 1 FOLLOWER]: Refusing update from remote peer 63af0eab427548a2b3549da6841ca4dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:20:44.721971 12030 consensus_queue.cc:1035] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "085f95dea5c040c9bac4c803a278d8a5" member_type: VOTER last_known_addr { host: "127.9.142.130" port: 46449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:44.722136 12024 consensus_queue.cc:1035] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec94ba237374d0ea529cce9572a5603" member_type: VOTER last_known_addr { host: "127.9.142.129" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:20:44.724726 12034 mvcc.cc:205] Tried to move back new op lower bound from 7317228931975843840 to 7317228931849404416. Current Snapshot: MvccSnapshot[applied={T|T < 7317228931975843840}]
I20260811 07:20:44.728266 11144 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:44.728366 11144 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:20:44.729198 11144 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 640e2fd20b1043eeb0166124fcf1bc5c: Sending DeleteTablet for 3 replicas of tablet 748cb334bbc14da383769c17b5882af3
I20260811 07:20:44.729627 11624 tablet_service.cc:1514] Processing DeleteTablet for tablet 748cb334bbc14da383769c17b5882af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:44 UTC) from {username='slave'} at 127.0.0.1:59894
I20260811 07:20:44.729673 11863 tablet_service.cc:1514] Processing DeleteTablet for tablet 748cb334bbc14da383769c17b5882af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:44 UTC) from {username='slave'} at 127.0.0.1:50144
I20260811 07:20:44.729916 12048 tablet_replica.cc:330] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: stopping tablet replica
I20260811 07:20:44.730026 11374 tablet_service.cc:1514] Processing DeleteTablet for tablet 748cb334bbc14da383769c17b5882af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:20:44 UTC) from {username='slave'} at 127.0.0.1:42948
I20260811 07:20:44.730096 12048 raft_consensus.cc:2229] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:20:44.730294 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 11270
I20260811 07:20:44.730315 12048 raft_consensus.cc:2258] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:44.754359 12048 ts_tablet_manager.cc:1905] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:20:44.756220 12048 ts_tablet_manager.cc:1918] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:44.756315 12048 log.cc:1196] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-2/wal/wals/748cb334bbc14da383769c17b5882af3
I20260811 07:20:44.756599 12048 ts_tablet_manager.cc:1939] T 748cb334bbc14da383769c17b5882af3 P 63af0eab427548a2b3549da6841ca4dd: Deleting consensus metadata
I20260811 07:20:44.756848 12049 tablet_replica.cc:330] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: stopping tablet replica
I20260811 07:20:44.757083 12049 raft_consensus.cc:2229] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:20:44.757100 11124 catalog_manager.cc:4841] TS 63af0eab427548a2b3549da6841ca4dd (127.9.142.131:41719): tablet 748cb334bbc14da383769c17b5882af3 (table test-table [id=b17d023144b14efba404791e95c52c30]) successfully deleted
I20260811 07:20:44.757332 12049 raft_consensus.cc:2258] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:20:44.757932 12049 ts_tablet_manager.cc:1905] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:20:44.760038 11119 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.142.129:43611 (error 108)
I20260811 07:20:44.760226 12049 ts_tablet_manager.cc:1918] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:20:44.760398 12049 log.cc:1196] T 748cb334bbc14da383769c17b5882af3 P 085f95dea5c040c9bac4c803a278d8a5: Deleting WAL directory at /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786432592145333-9786-0/minicluster-data/ts-1/wal/wals/748cb334bbc14da383769c17b5882af3
I20260811 07:20:44.760645 12002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.760465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.129:43611 (local address 127.0.0.1:42954)
0811 07:20:44.760534 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.760604 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.129:43611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 07:20:44.760774 11119 catalog_manager.cc:4584] TS dec94ba237374d0ea529cce9572a5603 (127.9.142.129:43611): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 748cb334bbc14da383769c17b5882af3: Network error: Client connection negotiation failed: client connection to 127.9.142.129:43611: connect: Connection refused (error 111)
I20260811 07:20:44.761022 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 11510
I20260811 07:20:44.777050 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 11745
I20260811 07:20:44.777241 12002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:44.777062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.130:46449 (local address 127.0.0.1:59902)
0811 07:20:44.777144 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 07:20:44.777186 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.130:46449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 07:20:44.804433 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 11094
2026-08-11T07:20:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (844 ms)
[----------] 6 tests from EncryptionPolicyTest (9992 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:44 dist-test-slave-7f01 krb5kdc[12057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:44 dist-test-slave-7f01 krb5kdc[12057](info): set up 2 sockets
Aug 11 07:20:44 dist-test-slave-7f01 krb5kdc[12057](info): commencing operation
krb5kdc: starting...
W20260811 07:20:46.115552 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:46 dist-test-slave-7f01 krb5kdc[12057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:20:46.242422 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40967
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:46.324311 12082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:46.324512 12082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:46.324536 12082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:46.325596 12082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:46.325634 12082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:46.325647 12082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:46.325660 12082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:46.325672 12082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:46.327080 12082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40967
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:46.327286 12082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:46.327452 12082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:46.332175 12096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:46.332211 12092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:46.332401 12082 server_base.cc:1034] running on GCE node
W20260811 07:20:46.332175 12091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:46.332692 12082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:46.333037 12082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:46.334214 12082 hybrid_clock.cc:648] HybridClock initialized: now 1786432846334192 us; error 38 us; skew 500 ppm
Aug 11 07:20:46 dist-test-slave-7f01 krb5kdc[12057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432846, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:46.336724 12082 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:20:46.337108 12082 webserver.cc:460] Webserver started at http://127.0.0.1:36503/ using document root <none> and password file <none>
I20260811 07:20:46.337415 12082 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:46.337466 12082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:46.337558 12082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:46.338528 12082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "4ca37786fbef45ebb66033837ccd0398"
format_stamp: "Formatted at 2026-08-11 07:20:46 on dist-test-slave-7f01"
server_key: "8b8c5fc8ec6eaf4b0b773d0722238027"
server_key_iv: "bcdf118f85538c61bda5f792491b8d4d"
server_key_version: "encryptionkey@0"
I20260811 07:20:46.338850 12082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "4ca37786fbef45ebb66033837ccd0398"
format_stamp: "Formatted at 2026-08-11 07:20:46 on dist-test-slave-7f01"
server_key: "8b8c5fc8ec6eaf4b0b773d0722238027"
server_key_iv: "bcdf118f85538c61bda5f792491b8d4d"
server_key_version: "encryptionkey@0"
I20260811 07:20:46.340189 12082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:20:46.340993 12113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:46.341197 12082 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:46.341296 12082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "4ca37786fbef45ebb66033837ccd0398"
format_stamp: "Formatted at 2026-08-11 07:20:46 on dist-test-slave-7f01"
server_key: "8b8c5fc8ec6eaf4b0b773d0722238027"
server_key_iv: "bcdf118f85538c61bda5f792491b8d4d"
server_key_version: "encryptionkey@0"
I20260811 07:20:46.341353 12082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:46.362442 12082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:46.364795 12082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:46.364903 12082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:46.368882 12082 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40967
I20260811 07:20:46.368937 12200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40967 every 8 connection(s)
I20260811 07:20:46.369295 12082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:46.370333 12201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:46.372661 12201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398: Bootstrap starting.
I20260811 07:20:46.373245 12201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:46.373559 12201 log.cc:824] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:46.374315 12201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398: No bootstrap required, opened a new log
I20260811 07:20:46.375977 12201 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca37786fbef45ebb66033837ccd0398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40967 } }
I20260811 07:20:46.376137 12201 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:46.376184 12201 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca37786fbef45ebb66033837ccd0398, State: Initialized, Role: FOLLOWER
I20260811 07:20:46.376369 12201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca37786fbef45ebb66033837ccd0398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40967 } }
I20260811 07:20:46.376477 12201 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:46.376525 12201 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:46.376578 12201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:46.377089 12201 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca37786fbef45ebb66033837ccd0398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40967 } }
I20260811 07:20:46.377213 12201 leader_election.cc:302] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ca37786fbef45ebb66033837ccd0398; no voters:
I20260811 07:20:46.377422 12201 leader_election.cc:288] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:46.377452 12207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:46.377497 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 12082
I20260811 07:20:46.377579 12207 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [term 1 LEADER]: Becoming Leader. State: Replica: 4ca37786fbef45ebb66033837ccd0398, State: Running, Role: LEADER
I20260811 07:20:46.377615 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:46.377692 12201 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:46.377665 12207 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca37786fbef45ebb66033837ccd0398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40967 } }
I20260811 07:20:46.377853 9786 external_mini_cluster.cc:1428] Setting key a1a675e2c6448561215d172d0809aa0d
I20260811 07:20:46.378008 12207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ca37786fbef45ebb66033837ccd0398. Latest consensus state: current_term: 1 leader_uuid: "4ca37786fbef45ebb66033837ccd0398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca37786fbef45ebb66033837ccd0398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40967 } } }
I20260811 07:20:46.378082 12207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:46.378404 12208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ca37786fbef45ebb66033837ccd0398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca37786fbef45ebb66033837ccd0398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40967 } } }
I20260811 07:20:46.378525 12208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:46.378541 12212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:46.379077 12212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:46.380723 12212 catalog_manager.cc:1347] Generated new cluster ID: 05c3664c3d3241a1994950599e95646d
I20260811 07:20:46.380777 12212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:20:46 dist-test-slave-7f01 krb5kdc[12057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:20:46.389716 12214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:46.378332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55337 (local address 127.0.0.1:40967)
0811 07:20:46.378738 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:46.378748 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:46.378783 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:20:46.378923 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:46.378931 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:46.378993 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:46.379140 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:46.379951 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:46.381343 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:46.382379 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:46.382990 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:46.383055 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:46.386036 (+ 2981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:46.386040 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:46.386040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:46.386052 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:46.388004 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:46.388462 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:46.388465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:46.388466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:46.388578 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:46.388825 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:46.388825 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:46.388826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:46.389113 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:46.389267 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:46.389404 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 07:20:46.389496 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":70,"threads_started":1}
I20260811 07:20:46.390779 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:20:46.396379 12212 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:46.396855 12212 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:46.404242 12214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:46.392172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45061 (local address 127.0.0.1:40967)
0811 07:20:46.392203 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:46.392205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:46.396039 (+ 3834us) server_negotiation.cc:407] Connection header received
0811 07:20:46.396245 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:46.396246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:46.396257 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:46.396308 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:46.397532 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:46.398221 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:46.399237 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:46.400052 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:46.400117 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:46.401472 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:46.401473 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:46.401473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:46.401479 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:46.402988 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:46.403401 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:46.403402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:46.403402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:46.403455 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:46.403682 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:46.403683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:46.403683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:46.403845 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:46.403938 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:46.404103 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 07:20:46.404162 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 07:20:46.411044 12212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ca37786fbef45ebb66033837ccd0398: Generated new TSK 0
I20260811 07:20:46.411221 12212 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:46.414366 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 12082
W20260811 07:20:46.430500 12053 connection.cc:535] client connection to 127.0.0.1:40967 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40967): Connection reset by peer (error 104)
2026-08-11T07:20:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1605 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:46 dist-test-slave-7f01 krb5kdc[12266](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:46 dist-test-slave-7f01 krb5kdc[12266](info): set up 2 sockets
Aug 11 07:20:46 dist-test-slave-7f01 krb5kdc[12266](info): commencing operation
krb5kdc: starting...
W20260811 07:20:47.730093 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:47 dist-test-slave-7f01 krb5kdc[12266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:20:47.850917 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45125
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:47.935927 12288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:47.936118 12288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:47.936141 12288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:47.937285 12288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:47.937325 12288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:47.937340 12288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:47.937386 12288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:47.937404 12288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:47.938866 12288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45125
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:47.939131 12288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:47.939352 12288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:47.944187 12293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:47.944245 12298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:47.944197 12294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:47.944522 12288 server_base.cc:1034] running on GCE node
I20260811 07:20:47.944818 12288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:47.945107 12288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:47.946275 12288 hybrid_clock.cc:648] HybridClock initialized: now 1786432847946256 us; error 39 us; skew 500 ppm
Aug 11 07:20:47 dist-test-slave-7f01 krb5kdc[12266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432847, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:47.948845 12288 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:20:47.949266 12288 webserver.cc:460] Webserver started at http://127.0.0.1:35821/ using document root <none> and password file <none>
I20260811 07:20:47.949510 12288 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:47.949584 12288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:47.949734 12288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:47.950737 12288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "5057d0ad3e7e461bbcd2b738157a55c9"
format_stamp: "Formatted at 2026-08-11 07:20:47 on dist-test-slave-7f01"
server_key: "f234d9d1165cddc8934e9454fc48ecf8"
server_key_iv: "5d4396d74ef91db5b0eb11a15ab83d83"
server_key_version: "encryptionkey@0"
I20260811 07:20:47.951107 12288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "5057d0ad3e7e461bbcd2b738157a55c9"
format_stamp: "Formatted at 2026-08-11 07:20:47 on dist-test-slave-7f01"
server_key: "f234d9d1165cddc8934e9454fc48ecf8"
server_key_iv: "5d4396d74ef91db5b0eb11a15ab83d83"
server_key_version: "encryptionkey@0"
I20260811 07:20:47.952499 12288 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:20:47.953210 12309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:47.953387 12288 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 07:20:47.953500 12288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "5057d0ad3e7e461bbcd2b738157a55c9"
format_stamp: "Formatted at 2026-08-11 07:20:47 on dist-test-slave-7f01"
server_key: "f234d9d1165cddc8934e9454fc48ecf8"
server_key_iv: "5d4396d74ef91db5b0eb11a15ab83d83"
server_key_version: "encryptionkey@0"
I20260811 07:20:47.953576 12288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:47.979319 12288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:47.981788 12288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:47.981964 12288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:47.986220 12288 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45125
I20260811 07:20:47.986279 12408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45125 every 8 connection(s)
I20260811 07:20:47.986666 12288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:47.987733 12409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:47.990144 12409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9: Bootstrap starting.
I20260811 07:20:47.990760 12409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:47.991077 12409 log.cc:824] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:47.991865 12409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9: No bootstrap required, opened a new log
I20260811 07:20:47.993464 12409 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5057d0ad3e7e461bbcd2b738157a55c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45125 } }
I20260811 07:20:47.993602 12409 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:47.993624 12409 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5057d0ad3e7e461bbcd2b738157a55c9, State: Initialized, Role: FOLLOWER
I20260811 07:20:47.993818 12409 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5057d0ad3e7e461bbcd2b738157a55c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45125 } }
I20260811 07:20:47.993887 12409 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:47.993930 12409 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:47.993983 12409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:47.994572 12409 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5057d0ad3e7e461bbcd2b738157a55c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45125 } }
I20260811 07:20:47.994694 12409 leader_election.cc:302] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5057d0ad3e7e461bbcd2b738157a55c9; no voters:
I20260811 07:20:47.994881 12409 leader_election.cc:288] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:47.994935 12415 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:47.995137 12409 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:47.995141 12415 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [term 1 LEADER]: Becoming Leader. State: Replica: 5057d0ad3e7e461bbcd2b738157a55c9, State: Running, Role: LEADER
I20260811 07:20:47.995260 12415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5057d0ad3e7e461bbcd2b738157a55c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45125 } }
I20260811 07:20:47.995646 12416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5057d0ad3e7e461bbcd2b738157a55c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5057d0ad3e7e461bbcd2b738157a55c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45125 } } }
I20260811 07:20:47.995757 12416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:47.995898 12420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5057d0ad3e7e461bbcd2b738157a55c9. Latest consensus state: current_term: 1 leader_uuid: "5057d0ad3e7e461bbcd2b738157a55c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5057d0ad3e7e461bbcd2b738157a55c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45125 } } }
I20260811 07:20:47.996021 12420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:47.996013 12439 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:47.996474 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 12288
I20260811 07:20:47.996606 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:47.996814 12439 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:47.996822 9786 external_mini_cluster.cc:1428] Setting key d81ef3fb3c76f7e2b964be7ed662c6d2
I20260811 07:20:47.998476 12439 catalog_manager.cc:1347] Generated new cluster ID: 96d698e8e1814d968dc389251e9df203
I20260811 07:20:47.998529 12439 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:48.003086 12456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:47.997302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59375 (local address 127.0.0.1:45125)
0811 07:20:47.997521 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:47.997529 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:47.997712 (+ 183us) server_negotiation.cc:407] Connection header received
0811 07:20:47.997861 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:47.997868 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:47.997922 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:47.998052 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:47.998420 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:47.999889 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:48.000958 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:48.001602 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:48.001714 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:48.002392 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:48.002395 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:48.002396 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:48.002607 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:48.002650 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:48.002665 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:48.002750 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:48.002845 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 07:20:48.002872 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":103,"threads_started":1}
I20260811 07:20:48.004155 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:20:48.011135 12456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:48.005736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51971 (local address 127.0.0.1:45125)
0811 07:20:48.005774 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:48.005775 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:48.007930 (+ 2155us) server_negotiation.cc:407] Connection header received
0811 07:20:48.007972 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:48.007973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:48.007984 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:48.008039 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:48.008170 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:48.008901 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:48.009848 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:48.010167 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:48.010238 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:48.010884 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:48.010886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:48.010886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:48.010890 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:48.010905 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:48.010909 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:48.010972 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:48.011049 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 07:20:48.011061 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 07:20:48.013154 12439 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:48.013633 12439 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:48.015588 12439 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5057d0ad3e7e461bbcd2b738157a55c9: Generated new TSK 0
I20260811 07:20:48.015784 12439 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:48.017549 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 12288
W20260811 07:20:48.032563 12262 connection.cc:535] client connection to 127.0.0.1:45125 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45125): Connection reset by peer (error 104)
2026-08-11T07:20:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1602 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:48 dist-test-slave-7f01 krb5kdc[12473](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:48 dist-test-slave-7f01 krb5kdc[12473](info): set up 2 sockets
Aug 11 07:20:48 dist-test-slave-7f01 krb5kdc[12473](info): commencing operation
krb5kdc: starting...
W20260811 07:20:49.303969 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:49 dist-test-slave-7f01 krb5kdc[12473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:20:49.432719 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46489
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46489
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:49.515427 12496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:49.515658 12496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:49.515695 12496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:49.516897 12496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:49.516957 12496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:49.516984 12496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:49.517016 12496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:49.517040 12496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:49.518466 12496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46489
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:49.518736 12496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:49.518975 12496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:49.523831 12505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:49.523972 12510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:49.523869 12507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:49.524024 12496 server_base.cc:1034] running on GCE node
I20260811 07:20:49.524276 12496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:49.524555 12496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:49.525727 12496 hybrid_clock.cc:648] HybridClock initialized: now 1786432849525706 us; error 33 us; skew 500 ppm
Aug 11 07:20:49 dist-test-slave-7f01 krb5kdc[12473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432849, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:49.528185 12496 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:20:49.528571 12496 webserver.cc:460] Webserver started at http://127.0.0.1:35745/ using document root <none> and password file <none>
I20260811 07:20:49.528748 12496 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:49.528787 12496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:49.528877 12496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:49.529827 12496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "1905373fa6c04588be8d378f1510959e"
format_stamp: "Formatted at 2026-08-11 07:20:49 on dist-test-slave-7f01"
server_key: "533b9edbb92763b614396a3aa184504e"
server_key_iv: "674c62f26d38f795fd8f29ef8040dc78"
server_key_version: "encryptionkey@0"
I20260811 07:20:49.530129 12496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "1905373fa6c04588be8d378f1510959e"
format_stamp: "Formatted at 2026-08-11 07:20:49 on dist-test-slave-7f01"
server_key: "533b9edbb92763b614396a3aa184504e"
server_key_iv: "674c62f26d38f795fd8f29ef8040dc78"
server_key_version: "encryptionkey@0"
I20260811 07:20:49.531404 12496 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:20:49.532236 12518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:49.532445 12496 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 07:20:49.532531 12496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "1905373fa6c04588be8d378f1510959e"
format_stamp: "Formatted at 2026-08-11 07:20:49 on dist-test-slave-7f01"
server_key: "533b9edbb92763b614396a3aa184504e"
server_key_iv: "674c62f26d38f795fd8f29ef8040dc78"
server_key_version: "encryptionkey@0"
I20260811 07:20:49.532583 12496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:49.535684 12496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:49.537815 12496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:49.537925 12496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:49.542290 12496 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46489
I20260811 07:20:49.542352 12612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46489 every 8 connection(s)
I20260811 07:20:49.542651 12496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:49.543618 12613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:49.545840 12613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e: Bootstrap starting.
I20260811 07:20:49.546439 12613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:49.546718 12613 log.cc:824] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:49.547078 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 12496
I20260811 07:20:49.547201 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:49.547386 9786 external_mini_cluster.cc:1428] Setting key 7911b4f1930d499c3e1340108bae7a64
I20260811 07:20:49.547574 12613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e: No bootstrap required, opened a new log
I20260811 07:20:49.549964 12613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1905373fa6c04588be8d378f1510959e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46489 } }
I20260811 07:20:49.550148 12613 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:49.550203 12613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1905373fa6c04588be8d378f1510959e, State: Initialized, Role: FOLLOWER
I20260811 07:20:49.550361 12613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1905373fa6c04588be8d378f1510959e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46489 } }
I20260811 07:20:49.550438 12613 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:49.550484 12613 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:49.550534 12613 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:49.551366 12613 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1905373fa6c04588be8d378f1510959e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46489 } }
I20260811 07:20:49.551489 12613 leader_election.cc:302] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1905373fa6c04588be8d378f1510959e; no voters:
I20260811 07:20:49.551677 12613 leader_election.cc:288] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:49.551731 12620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:49.551957 12619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:49.547883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50871 (local address 127.0.0.1:46489)
0811 07:20:49.548188 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:49.548197 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:49.548227 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:20:49.549044 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:49.549053 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:49.549085 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:49.549229 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:49.549840 (+ 611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:49.549844 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:49.549845 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:49.549849 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:49.549895 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:49.549909 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:49.549982 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:49.550043 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 07:20:49.550082 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":67,"threads_started":1}
I20260811 07:20:49.551956 12613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:49.551972 12620 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [term 1 LEADER]: Becoming Leader. State: Replica: 1905373fa6c04588be8d378f1510959e, State: Running, Role: LEADER
I20260811 07:20:49.552281 12620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1905373fa6c04588be8d378f1510959e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46489 } }
I20260811 07:20:49.552672 12625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1905373fa6c04588be8d378f1510959e. Latest consensus state: current_term: 1 leader_uuid: "1905373fa6c04588be8d378f1510959e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1905373fa6c04588be8d378f1510959e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46489 } } }
I20260811 07:20:49.552682 12624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1905373fa6c04588be8d378f1510959e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1905373fa6c04588be8d378f1510959e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46489 } } }
I20260811 07:20:49.552794 12624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:49.552780 12625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:49.553150 12634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:49.553196 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:20:49.553790 12634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:49.555578 12634 catalog_manager.cc:1347] Generated new cluster ID: b1f2ec65a2d44faaa37d0f76b82f6452
I20260811 07:20:49.555653 12634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:49.556221 12619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:49.555036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59027 (local address 127.0.0.1:46489)
0811 07:20:49.555067 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:49.555069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:49.555215 (+ 146us) server_negotiation.cc:407] Connection header received
0811 07:20:49.555291 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:49.555292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:49.555297 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:49.555361 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:49.555998 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:49.555999 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:49.555999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:49.556003 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:49.556019 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:49.556024 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:49.556086 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:49.556148 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 07:20:49.556162 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 07:20:49.568007 12634 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:49.568173 12634 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:49.571172 12634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1905373fa6c04588be8d378f1510959e: Generated new TSK 0
I20260811 07:20:49.571342 12634 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:49.575682 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 12496
2026-08-11T07:20:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1556 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:49 dist-test-slave-7f01 krb5kdc[12659](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:49 dist-test-slave-7f01 krb5kdc[12659](info): set up 2 sockets
Aug 11 07:20:49 dist-test-slave-7f01 krb5kdc[12659](info): commencing operation
krb5kdc: starting...
W20260811 07:20:50.924646 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:51 dist-test-slave-7f01 krb5kdc[12659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432851, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:20:51.066946 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39603
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:51.152801 12686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:51.153029 12686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:51.153079 12686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:51.154191 12686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:51.154258 12686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:51.154284 12686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:51.154311 12686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:51.154366 12686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:51.155913 12686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:51.156177 12686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:51.156406 12686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:51.161342 12693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:51.161303 12692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:51.161296 12696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:51.161630 12686 server_base.cc:1034] running on GCE node
I20260811 07:20:51.161907 12686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:51.162177 12686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:51.163362 12686 hybrid_clock.cc:648] HybridClock initialized: now 1786432851163342 us; error 37 us; skew 500 ppm
Aug 11 07:20:51 dist-test-slave-7f01 krb5kdc[12659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432851, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:51.169371 12686 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:20:51.169821 12686 webserver.cc:460] Webserver started at http://127.0.0.1:36101/ using document root <none> and password file <none>
I20260811 07:20:51.170094 12686 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:51.170166 12686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:51.170315 12686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:51.171350 12686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "f4c65c7b1afb4125891e9373ceb1b3c0"
format_stamp: "Formatted at 2026-08-11 07:20:51 on dist-test-slave-7f01"
server_key: "2135d81731ab599e045d4844f2a46c6c"
server_key_iv: "54b0df088eefbbc437ca467c4c5dc5c7"
server_key_version: "encryptionkey@0"
I20260811 07:20:51.171727 12686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "f4c65c7b1afb4125891e9373ceb1b3c0"
format_stamp: "Formatted at 2026-08-11 07:20:51 on dist-test-slave-7f01"
server_key: "2135d81731ab599e045d4844f2a46c6c"
server_key_iv: "54b0df088eefbbc437ca467c4c5dc5c7"
server_key_version: "encryptionkey@0"
I20260811 07:20:51.173128 12686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:51.173902 12714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:51.174083 12686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:20:51.174178 12686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "f4c65c7b1afb4125891e9373ceb1b3c0"
format_stamp: "Formatted at 2026-08-11 07:20:51 on dist-test-slave-7f01"
server_key: "2135d81731ab599e045d4844f2a46c6c"
server_key_iv: "54b0df088eefbbc437ca467c4c5dc5c7"
server_key_version: "encryptionkey@0"
I20260811 07:20:51.174261 12686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:51.181813 12686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:51.184104 12686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:51.184263 12686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:51.188625 12686 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39603
I20260811 07:20:51.188660 12798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39603 every 8 connection(s)
I20260811 07:20:51.189020 12686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:51.190035 12801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:51.192302 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 12686
I20260811 07:20:51.192423 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:51.192457 12801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0: Bootstrap starting.
I20260811 07:20:51.192625 9786 external_mini_cluster.cc:1428] Setting key 0b1ff23d1b8173b42e77626ed88e4646
I20260811 07:20:51.193212 12801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:51.193523 12801 log.cc:824] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:51.194357 12801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0: No bootstrap required, opened a new log
I20260811 07:20:51.196635 12801 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c65c7b1afb4125891e9373ceb1b3c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39603 } }
I20260811 07:20:51.196803 12801 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:51.196836 12801 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4c65c7b1afb4125891e9373ceb1b3c0, State: Initialized, Role: FOLLOWER
I20260811 07:20:51.196956 12801 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c65c7b1afb4125891e9373ceb1b3c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39603 } }
I20260811 07:20:51.197055 12801 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:51.197105 12801 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:51.197157 12801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:51.197798 12801 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c65c7b1afb4125891e9373ceb1b3c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39603 } }
I20260811 07:20:51.197925 12801 leader_election.cc:302] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4c65c7b1afb4125891e9373ceb1b3c0; no voters:
I20260811 07:20:51.198110 12801 leader_election.cc:288] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:51.198262 12808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:51.198379 12801 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:51.198392 12808 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [term 1 LEADER]: Becoming Leader. State: Replica: f4c65c7b1afb4125891e9373ceb1b3c0, State: Running, Role: LEADER
I20260811 07:20:51.198498 12808 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c65c7b1afb4125891e9373ceb1b3c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39603 } }
I20260811 07:20:51.198836 12808 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4c65c7b1afb4125891e9373ceb1b3c0. Latest consensus state: current_term: 1 leader_uuid: "f4c65c7b1afb4125891e9373ceb1b3c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c65c7b1afb4125891e9373ceb1b3c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39603 } } }
I20260811 07:20:51.198848 12807 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4c65c7b1afb4125891e9373ceb1b3c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4c65c7b1afb4125891e9373ceb1b3c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39603 } } }
I20260811 07:20:51.198951 12808 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:51.198974 12807 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:51.199208 12820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:51.199756 12820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 07:20:51 dist-test-slave-7f01 krb5kdc[12659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432851, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:20:51.201547 12820 catalog_manager.cc:1347] Generated new cluster ID: 6914ec6944304bc7a48bd36ead8f9fd5
I20260811 07:20:51.201625 12820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:51.204650 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:51.193163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33329 (local address 127.0.0.1:39603)
0811 07:20:51.193343 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:51.193352 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:51.193399 (+ 47us) server_negotiation.cc:407] Connection header received
0811 07:20:51.193990 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:51.193999 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:51.194066 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:51.194183 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:51.194991 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:51.195974 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:51.197031 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:51.197550 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:51.197628 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:51.200882 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:51.200887 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:51.200888 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:51.200902 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:51.202968 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:51.203362 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:51.203365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:51.203366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:51.203479 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:51.203687 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:51.203688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:51.203688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:51.204035 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:51.204212 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:51.204293 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 07:20:51.204435 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260811 07:20:51.205523 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:20:51.211549 12820 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:51.212262 12820 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:51.214479 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:51.207113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51531 (local address 127.0.0.1:39603)
0811 07:20:51.207151 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:51.207153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:51.207328 (+ 175us) server_negotiation.cc:407] Connection header received
0811 07:20:51.207372 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:51.207373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:51.207383 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:51.207441 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:51.208042 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:51.208813 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:51.209804 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:51.210148 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:51.210223 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:51.211562 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:51.211563 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:51.211564 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:51.211571 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:51.213222 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:51.213626 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:51.213627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:51.213628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:51.213684 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:51.213895 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:51.213896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:51.213896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:51.214015 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:51.214088 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:51.214288 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 07:20:51.214379 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:20:51.217563 12820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4c65c7b1afb4125891e9373ceb1b3c0: Generated new TSK 0
I20260811 07:20:51.217736 12820 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:51.224073 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 12686
2026-08-11T07:20:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1646 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:51 dist-test-slave-7f01 krb5kdc[12850](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:51 dist-test-slave-7f01 krb5kdc[12850](info): set up 2 sockets
Aug 11 07:20:51 dist-test-slave-7f01 krb5kdc[12850](info): commencing operation
krb5kdc: starting...
W20260811 07:20:52.523777 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:52 dist-test-slave-7f01 krb5kdc[12850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:20:52.647255 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46679
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:52.733634 12881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:52.733824 12881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:52.733845 12881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:52.734937 12881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:52.734979 12881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:52.734994 12881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:52.735008 12881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:52.735019 12881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:52.736428 12881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:52.736618 12881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:52.736783 12881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:52.741587 12893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:52.741614 12891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:52.741729 12881 server_base.cc:1034] running on GCE node
W20260811 07:20:52.741626 12890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:52.742105 12881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:52.742394 12881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:52.743551 12881 hybrid_clock.cc:648] HybridClock initialized: now 1786432852743541 us; error 31 us; skew 500 ppm
Aug 11 07:20:52 dist-test-slave-7f01 krb5kdc[12850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432852, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:52.746062 12881 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:20:52.746449 12881 webserver.cc:460] Webserver started at http://127.0.0.1:35097/ using document root <none> and password file <none>
I20260811 07:20:52.746649 12881 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:52.746690 12881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:52.746794 12881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:52.747859 12881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "25c1dd12c80d43d9beaf4d016408b003"
format_stamp: "Formatted at 2026-08-11 07:20:52 on dist-test-slave-7f01"
server_key: "bcd4c0c8af70f622c5331a2153755ad0"
server_key_iv: "64e926f54fef4bd90f7cb5b77c6276fb"
server_key_version: "encryptionkey@0"
I20260811 07:20:52.748164 12881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "25c1dd12c80d43d9beaf4d016408b003"
format_stamp: "Formatted at 2026-08-11 07:20:52 on dist-test-slave-7f01"
server_key: "bcd4c0c8af70f622c5331a2153755ad0"
server_key_iv: "64e926f54fef4bd90f7cb5b77c6276fb"
server_key_version: "encryptionkey@0"
I20260811 07:20:52.749470 12881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:52.750209 12902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:52.750442 12881 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:52.750536 12881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "25c1dd12c80d43d9beaf4d016408b003"
format_stamp: "Formatted at 2026-08-11 07:20:52 on dist-test-slave-7f01"
server_key: "bcd4c0c8af70f622c5331a2153755ad0"
server_key_iv: "64e926f54fef4bd90f7cb5b77c6276fb"
server_key_version: "encryptionkey@0"
I20260811 07:20:52.750592 12881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:52.763286 12881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:52.765270 12881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:52.765383 12881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:52.769548 12881 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46679
I20260811 07:20:52.769627 12992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46679 every 8 connection(s)
I20260811 07:20:52.769955 12881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:52.771003 12993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:52.772356 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 12881
I20260811 07:20:52.772502 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:52.772722 9786 external_mini_cluster.cc:1428] Setting key 96feeae2855adc08ef19300b795f70fa
I20260811 07:20:52.773870 12993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003: Bootstrap starting.
I20260811 07:20:52.774463 12993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:52.774766 12993 log.cc:824] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:52.775540 12993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003: No bootstrap required, opened a new log
I20260811 07:20:52.777570 12993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c1dd12c80d43d9beaf4d016408b003" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46679 } }
I20260811 07:20:52.777757 12993 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:52.777810 12993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c1dd12c80d43d9beaf4d016408b003, State: Initialized, Role: FOLLOWER
I20260811 07:20:52.777953 12993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c1dd12c80d43d9beaf4d016408b003" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46679 } }
I20260811 07:20:52.778038 12993 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:52.778084 12993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:52.778142 12993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:52.778560 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:52.773248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55665 (local address 127.0.0.1:46679)
0811 07:20:52.773489 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:52.773496 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:52.773522 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:20:52.773946 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:52.773955 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:52.774018 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:52.774175 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:52.774392 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:52.775666 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:52.776518 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:52.776941 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:52.777065 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:52.777764 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:52.777769 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:52.777769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:52.777980 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:52.778020 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:52.778038 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:52.778122 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:52.778243 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 07:20:52.778330 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":103,"threads_started":1}
I20260811 07:20:52.778769 12993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c1dd12c80d43d9beaf4d016408b003" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46679 } }
I20260811 07:20:52.778894 12993 leader_election.cc:302] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25c1dd12c80d43d9beaf4d016408b003; no voters:
I20260811 07:20:52.779057 12993 leader_election.cc:288] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:52.779215 13001 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:52.779353 13001 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [term 1 LEADER]: Becoming Leader. State: Replica: 25c1dd12c80d43d9beaf4d016408b003, State: Running, Role: LEADER
I20260811 07:20:52.779350 12993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:52.779464 13001 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c1dd12c80d43d9beaf4d016408b003" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46679 } }
I20260811 07:20:52.779553 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:20:52.779830 13005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25c1dd12c80d43d9beaf4d016408b003" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c1dd12c80d43d9beaf4d016408b003" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46679 } } }
I20260811 07:20:52.779924 13005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:52.780092 13007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25c1dd12c80d43d9beaf4d016408b003. Latest consensus state: current_term: 1 leader_uuid: "25c1dd12c80d43d9beaf4d016408b003" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c1dd12c80d43d9beaf4d016408b003" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46679 } } }
I20260811 07:20:52.780153 13007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003 [sys.catalog]: This master's current role is: LEADER
W20260811 07:20:52.781348 13038 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:20:52.781459 13038 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:20:52.781535 13013 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:52.781711 13013 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:52.783239 13013 catalog_manager.cc:1347] Generated new cluster ID: f82bc1fcfb16472794730630ce40391e
I20260811 07:20:52.783293 13013 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:52.784698 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:52.781381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46383 (local address 127.0.0.1:46679)
0811 07:20:52.781432 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:52.781434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:52.781539 (+ 105us) server_negotiation.cc:407] Connection header received
0811 07:20:52.781635 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:52.781636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:52.781645 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:52.781694 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:52.781847 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:52.782534 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:52.783487 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:52.783799 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:52.783860 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:52.784490 (+ 630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:52.784491 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:52.784491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:52.784495 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:52.784509 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:52.784514 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:52.784562 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:52.784610 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 07:20:52.784631 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 07:20:52.792836 13013 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:52.793383 13013 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:52.798281 13013 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25c1dd12c80d43d9beaf4d016408b003: Generated new TSK 0
I20260811 07:20:52.798470 13013 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:52.801367 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 12881
2026-08-11T07:20:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1578 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:52 dist-test-slave-7f01 krb5kdc[13049](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:52 dist-test-slave-7f01 krb5kdc[13049](info): set up 2 sockets
Aug 11 07:20:52 dist-test-slave-7f01 krb5kdc[13049](info): commencing operation
krb5kdc: starting...
W20260811 07:20:54.107303 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:54 dist-test-slave-7f01 krb5kdc[13049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:20:54.231202 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40063
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:54.315253 13069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:54.315500 13069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:54.315542 13069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:54.316709 13069 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:54.316780 13069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:54.316813 13069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:54.316844 13069 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:54.316869 13069 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:54.318351 13069 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:54.318638 13069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:54.318876 13069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:54.323751 13087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:54.323762 13080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:54.323766 13078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:54.324080 13069 server_base.cc:1034] running on GCE node
I20260811 07:20:54.324398 13069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:54.324699 13069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:54.325881 13069 hybrid_clock.cc:648] HybridClock initialized: now 1786432854325860 us; error 37 us; skew 500 ppm
Aug 11 07:20:54 dist-test-slave-7f01 krb5kdc[13049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432854, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:54.328576 13069 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:20:54.329021 13069 webserver.cc:460] Webserver started at http://127.0.0.1:35325/ using document root <none> and password file <none>
I20260811 07:20:54.329298 13069 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:54.329373 13069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:54.329532 13069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:54.330592 13069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "1af66e4fa4a445efaf9197054b79aa35"
format_stamp: "Formatted at 2026-08-11 07:20:54 on dist-test-slave-7f01"
server_key: "a1484602d299bc446e5d0e058fb333cf"
server_key_iv: "e724d6554e7a68e4bcb1ed780e50479d"
server_key_version: "encryptionkey@0"
I20260811 07:20:54.330979 13069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "1af66e4fa4a445efaf9197054b79aa35"
format_stamp: "Formatted at 2026-08-11 07:20:54 on dist-test-slave-7f01"
server_key: "a1484602d299bc446e5d0e058fb333cf"
server_key_iv: "e724d6554e7a68e4bcb1ed780e50479d"
server_key_version: "encryptionkey@0"
I20260811 07:20:54.332427 13069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 07:20:54.333257 13096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:54.333500 13069 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:54.333623 13069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "1af66e4fa4a445efaf9197054b79aa35"
format_stamp: "Formatted at 2026-08-11 07:20:54 on dist-test-slave-7f01"
server_key: "a1484602d299bc446e5d0e058fb333cf"
server_key_iv: "e724d6554e7a68e4bcb1ed780e50479d"
server_key_version: "encryptionkey@0"
I20260811 07:20:54.333705 13069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:54.337116 13069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:54.339082 13069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:54.339239 13069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:54.343451 13069 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40063
I20260811 07:20:54.343480 13191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40063 every 8 connection(s)
I20260811 07:20:54.343868 13069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:54.344913 13192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:54.347112 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 13069
I20260811 07:20:54.347231 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:54.347383 13192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35: Bootstrap starting.
I20260811 07:20:54.347453 9786 external_mini_cluster.cc:1428] Setting key 8b626c28f8b3966e4477242fa59919e5
I20260811 07:20:54.348152 13192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:54.348479 13192 log.cc:824] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:54.349277 13192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35: No bootstrap required, opened a new log
I20260811 07:20:54.350082 13198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:54.347951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44551 (local address 127.0.0.1:40063)
0811 07:20:54.348143 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:54.348151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:54.348175 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:20:54.348753 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:54.348762 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:54.348796 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:54.348947 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:54.349666 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:54.349670 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:54.349670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:54.349674 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:54.349724 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:54.349736 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:54.349842 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:54.349875 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 07:20:54.349915 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260811 07:20:54.350929 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:20:54.351574 13192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1af66e4fa4a445efaf9197054b79aa35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } }
I20260811 07:20:54.351734 13192 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:54.351820 13192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1af66e4fa4a445efaf9197054b79aa35, State: Initialized, Role: FOLLOWER
I20260811 07:20:54.351950 13192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1af66e4fa4a445efaf9197054b79aa35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } }
I20260811 07:20:54.352054 13192 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:54.352113 13192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:54.352166 13192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:54.352975 13192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1af66e4fa4a445efaf9197054b79aa35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } }
I20260811 07:20:54.353101 13192 leader_election.cc:302] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1af66e4fa4a445efaf9197054b79aa35; no voters:
I20260811 07:20:54.353282 13192 leader_election.cc:288] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:54.353314 13207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:54.353425 13198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:54.352434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38547 (local address 127.0.0.1:40063)
0811 07:20:54.352471 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:54.352472 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:54.352530 (+ 58us) server_negotiation.cc:407] Connection header received
0811 07:20:54.352596 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:54.352596 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:54.352599 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:54.352642 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:54.353148 (+ 506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:54.353149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:54.353149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:54.353154 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:54.353168 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:54.353172 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:54.353227 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:54.353298 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 07:20:54.353312 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:20:54.353559 13207 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [term 1 LEADER]: Becoming Leader. State: Replica: 1af66e4fa4a445efaf9197054b79aa35, State: Running, Role: LEADER
I20260811 07:20:54.353598 13192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:54.353657 13207 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1af66e4fa4a445efaf9197054b79aa35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } }
I20260811 07:20:54.354041 13207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1af66e4fa4a445efaf9197054b79aa35. Latest consensus state: current_term: 1 leader_uuid: "1af66e4fa4a445efaf9197054b79aa35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1af66e4fa4a445efaf9197054b79aa35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } } }
I20260811 07:20:54.354056 13208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1af66e4fa4a445efaf9197054b79aa35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1af66e4fa4a445efaf9197054b79aa35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } } }
I20260811 07:20:54.354239 13208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:54.354615 13207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:54.354748 13224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:54.355329 13224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:54.356967 13224 catalog_manager.cc:1347] Generated new cluster ID: c0f89da0cfc441e5b1d93267aef5abe5
I20260811 07:20:54.357028 13224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:54.371538 13224 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:54.371769 13224 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:54.380210 13224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1af66e4fa4a445efaf9197054b79aa35: Generated new TSK 0
I20260811 07:20:54.380451 13224 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:54.387974 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 13069
2026-08-11T07:20:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1591 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:54 dist-test-slave-7f01 krb5kdc[13245](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:54 dist-test-slave-7f01 krb5kdc[13245](info): set up 2 sockets
Aug 11 07:20:54 dist-test-slave-7f01 krb5kdc[13245](info): commencing operation
krb5kdc: starting...
W20260811 07:20:55.702826 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:55 dist-test-slave-7f01 krb5kdc[13245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:20:55.839371 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46579
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:55.935156 13267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:55.935441 13267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:55.935485 13267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:55.936684 13267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:55.936761 13267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:55.936786 13267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:55.936817 13267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:55.936849 13267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:55.938416 13267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:55.938738 13267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:55.938995 13267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:55.944370 13274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:55.944581 13275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:55.944367 13277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:55.944742 13267 server_base.cc:1034] running on GCE node
I20260811 07:20:55.945006 13267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:55.945304 13267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:55.946503 13267 hybrid_clock.cc:648] HybridClock initialized: now 1786432855946477 us; error 42 us; skew 500 ppm
Aug 11 07:20:55 dist-test-slave-7f01 krb5kdc[13245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432855, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:55.949810 13267 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:20:55.950347 13267 webserver.cc:460] Webserver started at http://127.0.0.1:46621/ using document root <none> and password file <none>
I20260811 07:20:55.950623 13267 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:55.950697 13267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:55.950855 13267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:55.952277 13267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "078fc69c6d5c451da144f46dbdf71531"
format_stamp: "Formatted at 2026-08-11 07:20:55 on dist-test-slave-7f01"
server_key: "3c700e039397e587763907b6d5ef7325"
server_key_iv: "a41469f8660351a47538272a05916458"
server_key_version: "encryptionkey@0"
I20260811 07:20:55.952800 13267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "078fc69c6d5c451da144f46dbdf71531"
format_stamp: "Formatted at 2026-08-11 07:20:55 on dist-test-slave-7f01"
server_key: "3c700e039397e587763907b6d5ef7325"
server_key_iv: "a41469f8660351a47538272a05916458"
server_key_version: "encryptionkey@0"
I20260811 07:20:55.954586 13267 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 07:20:55.955474 13285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:55.955935 13267 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:55.956073 13267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "078fc69c6d5c451da144f46dbdf71531"
format_stamp: "Formatted at 2026-08-11 07:20:55 on dist-test-slave-7f01"
server_key: "3c700e039397e587763907b6d5ef7325"
server_key_iv: "a41469f8660351a47538272a05916458"
server_key_version: "encryptionkey@0"
I20260811 07:20:55.956167 13267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:55.974078 13267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:55.977166 13267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:55.977371 13267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:55.982466 13267 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46579
I20260811 07:20:55.982513 13381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46579 every 8 connection(s)
I20260811 07:20:55.982913 13267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:55.984014 13382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:55.986064 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 13267
I20260811 07:20:55.986223 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:55.986579 9786 external_mini_cluster.cc:1428] Setting key 165a2429b9bdcfad5c132d9cffc5590f
I20260811 07:20:55.986590 13382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531: Bootstrap starting.
I20260811 07:20:55.987428 13382 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:55.987824 13382 log.cc:824] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:55.988686 13382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531: No bootstrap required, opened a new log
I20260811 07:20:55.991078 13382 raft_consensus.cc:348] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078fc69c6d5c451da144f46dbdf71531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46579 } }
I20260811 07:20:55.991218 13382 raft_consensus.cc:374] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:55.991241 13382 raft_consensus.cc:729] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 078fc69c6d5c451da144f46dbdf71531, State: Initialized, Role: FOLLOWER
I20260811 07:20:55.991394 13382 consensus_queue.cc:260] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078fc69c6d5c451da144f46dbdf71531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46579 } }
I20260811 07:20:55.991498 13382 raft_consensus.cc:388] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:55.991544 13382 raft_consensus.cc:482] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:55.991600 13382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:55.992471 13382 raft_consensus.cc:504] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078fc69c6d5c451da144f46dbdf71531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46579 } }
I20260811 07:20:55.992657 13382 leader_election.cc:302] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 078fc69c6d5c451da144f46dbdf71531; no voters:
I20260811 07:20:55.992877 13382 leader_election.cc:288] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:55.992900 13395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:55.993054 13395 raft_consensus.cc:686] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [term 1 LEADER]: Becoming Leader. State: Replica: 078fc69c6d5c451da144f46dbdf71531, State: Running, Role: LEADER
I20260811 07:20:55.993156 13395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078fc69c6d5c451da144f46dbdf71531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46579 } }
I20260811 07:20:55.993209 13382 sys_catalog.cc:564] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:55.993508 13395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 078fc69c6d5c451da144f46dbdf71531. Latest consensus state: current_term: 1 leader_uuid: "078fc69c6d5c451da144f46dbdf71531" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078fc69c6d5c451da144f46dbdf71531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46579 } } }
I20260811 07:20:55.993743 13395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:55.993665 13396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "078fc69c6d5c451da144f46dbdf71531" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "078fc69c6d5c451da144f46dbdf71531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46579 } } }
I20260811 07:20:55.994174 13396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531 [sys.catalog]: This master's current role is: LEADER
Aug 11 07:20:55 dist-test-slave-7f01 krb5kdc[13245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
W20260811 07:20:55.995172 13420 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:20:55.995229 13420 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:20:55.995288 13407 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:55.995474 13407 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:55.997383 13407 catalog_manager.cc:1347] Generated new cluster ID: 59727b34725e4028b3b911a2e52912f6
I20260811 07:20:55.997437 13407 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:55.999904 13393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:55.987370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:51731 (local address 127.0.0.1:46579)
0811 07:20:55.987655 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:55.987665 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:55.987705 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:20:55.988282 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:55.988290 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:55.988378 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:55.988533 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:55.989253 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:55.990708 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:55.991848 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:55.992305 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:55.992944 (+ 639us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:55.995815 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:55.995819 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:55.995819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:55.995832 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:55.997925 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:55.998538 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:55.998541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:55.998541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:55.998646 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:55.998936 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:55.998937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:55.998937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:55.999224 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:55.999386 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:55.999539 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 07:20:55.999641 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":91,"threads_started":1}
I20260811 07:20:56.000815 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:20:56.008056 13407 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:56.008755 13407 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:56.012639 13407 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 078fc69c6d5c451da144f46dbdf71531: Generated new TSK 0
I20260811 07:20:56.012842 13407 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:56.015980 13393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:56.004129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:34477 (local address 127.0.0.1:46579)
0811 07:20:56.004168 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:56.004170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:56.007639 (+ 3469us) server_negotiation.cc:407] Connection header received
0811 07:20:56.007712 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:56.007713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:56.007724 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:56.007792 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:56.008527 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:56.009113 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:56.009839 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:56.010055 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:56.010263 (+ 208us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:56.012003 (+ 1740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:56.012005 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:56.012005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:20:56.012012 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:56.014364 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:56.014955 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:56.014956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:56.014956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:56.015024 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:20:56.015255 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:20:56.015256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:20:56.015256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:20:56.015461 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:56.015613 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:56.015785 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:20:56.015855 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:20:56.018246 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 13267
W20260811 07:20:56.033284 13243 connection.cc:535] client connection to 127.0.0.1:46579 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46579): Connection reset by peer (error 104)
2026-08-11T07:20:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1628 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:56 dist-test-slave-7f01 krb5kdc[13437](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:56 dist-test-slave-7f01 krb5kdc[13437](info): set up 2 sockets
Aug 11 07:20:56 dist-test-slave-7f01 krb5kdc[13437](info): commencing operation
krb5kdc: starting...
W20260811 07:20:57.313467 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:57 dist-test-slave-7f01 krb5kdc[13437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:20:57.451319 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45093
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:57.535266 13457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:57.535523 13457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:57.535562 13457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:57.536693 13457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:57.536768 13457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:57.536794 13457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:57.536823 13457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:57.536859 13457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:57.538322 13457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:57.538602 13457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:57.538834 13457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:20:57.543670 13457 server_base.cc:1034] running on GCE node
W20260811 07:20:57.543668 13467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:57.543881 13470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:57.543718 13466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:57.544198 13457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:57.544516 13457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:57.545680 13457 hybrid_clock.cc:648] HybridClock initialized: now 1786432857545675 us; error 37 us; skew 500 ppm
Aug 11 07:20:57 dist-test-slave-7f01 krb5kdc[13437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432857, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:57.553017 13457 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:20:57.553560 13457 webserver.cc:460] Webserver started at http://127.0.0.1:33283/ using document root <none> and password file <none>
I20260811 07:20:57.553812 13457 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:57.553881 13457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:57.554045 13457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:57.555158 13457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "ac4f2f6ef5e4485094944f7ef13c73c2"
format_stamp: "Formatted at 2026-08-11 07:20:57 on dist-test-slave-7f01"
server_key: "64ae2773ac219988c2f53c22a3c2ddc3"
server_key_iv: "673f9234ab4e60bbebc38b511e511065"
server_key_version: "encryptionkey@0"
I20260811 07:20:57.555540 13457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "ac4f2f6ef5e4485094944f7ef13c73c2"
format_stamp: "Formatted at 2026-08-11 07:20:57 on dist-test-slave-7f01"
server_key: "64ae2773ac219988c2f53c22a3c2ddc3"
server_key_iv: "673f9234ab4e60bbebc38b511e511065"
server_key_version: "encryptionkey@0"
I20260811 07:20:57.557063 13457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:57.557925 13488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:57.558139 13457 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:20:57.558257 13457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "ac4f2f6ef5e4485094944f7ef13c73c2"
format_stamp: "Formatted at 2026-08-11 07:20:57 on dist-test-slave-7f01"
server_key: "64ae2773ac219988c2f53c22a3c2ddc3"
server_key_iv: "673f9234ab4e60bbebc38b511e511065"
server_key_version: "encryptionkey@0"
I20260811 07:20:57.558336 13457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:57.573705 13457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:57.575573 13457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:57.575789 13457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:57.580196 13457 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45093
I20260811 07:20:57.580252 13575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45093 every 8 connection(s)
I20260811 07:20:57.580629 13457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:57.581666 13576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:57.584097 13576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2: Bootstrap starting.
I20260811 07:20:57.584714 13576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:57.585050 13576 log.cc:824] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:57.585757 13576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2: No bootstrap required, opened a new log
I20260811 07:20:57.587426 13576 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac4f2f6ef5e4485094944f7ef13c73c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } }
I20260811 07:20:57.587568 13576 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:57.587592 13576 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4f2f6ef5e4485094944f7ef13c73c2, State: Initialized, Role: FOLLOWER
I20260811 07:20:57.587833 13576 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac4f2f6ef5e4485094944f7ef13c73c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } }
I20260811 07:20:57.587906 13576 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:57.587949 13576 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:57.587945 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 13457
I20260811 07:20:57.588001 13576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:57.588099 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:57.588299 9786 external_mini_cluster.cc:1428] Setting key 4e840d59860bb3a2e8df160889e8f7e9
I20260811 07:20:57.588701 13576 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac4f2f6ef5e4485094944f7ef13c73c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } }
I20260811 07:20:57.588829 13576 leader_election.cc:302] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac4f2f6ef5e4485094944f7ef13c73c2; no voters:
I20260811 07:20:57.589006 13576 leader_election.cc:288] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:57.589032 13581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:57.589236 13581 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [term 1 LEADER]: Becoming Leader. State: Replica: ac4f2f6ef5e4485094944f7ef13c73c2, State: Running, Role: LEADER
I20260811 07:20:57.589325 13576 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:57.589387 13581 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac4f2f6ef5e4485094944f7ef13c73c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } }
I20260811 07:20:57.589798 13581 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac4f2f6ef5e4485094944f7ef13c73c2. Latest consensus state: current_term: 1 leader_uuid: "ac4f2f6ef5e4485094944f7ef13c73c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac4f2f6ef5e4485094944f7ef13c73c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } } }
I20260811 07:20:57.590034 13581 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:57.589964 13584 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac4f2f6ef5e4485094944f7ef13c73c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac4f2f6ef5e4485094944f7ef13c73c2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45093 } } }
I20260811 07:20:57.590266 13584 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2 [sys.catalog]: This master's current role is: LEADER
W20260811 07:20:57.591562 13613 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:20:57.591634 13613 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:20:57.591707 13591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:57.591893 13591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:57.593322 13591 catalog_manager.cc:1347] Generated new cluster ID: 078bb34fc8cc4dddbafa39f2f0eed1f0
I20260811 07:20:57.593381 13591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:57.594552 13580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:57.588801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:38165 (local address 127.0.0.1:45093)
0811 07:20:57.589003 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:57.589013 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:57.589051 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:20:57.589175 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:57.589184 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:57.589246 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:57.589679 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:57.589793 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:57.591048 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:57.592220 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:57.592818 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:57.592931 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:57.593826 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:57.593830 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:57.593830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:57.594042 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:57.594079 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:57.594092 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:57.594171 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:57.594311 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 07:20:57.594338 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":80,"threads_started":1}
I20260811 07:20:57.595510 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:20:57.600610 13580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:57.597098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:59679 (local address 127.0.0.1:45093)
0811 07:20:57.597132 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:57.597134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:57.597190 (+ 56us) server_negotiation.cc:407] Connection header received
0811 07:20:57.597244 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:57.597245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:57.597264 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:57.597331 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:57.597477 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:57.598259 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:57.599244 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:20:57.599578 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:20:57.599651 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:20:57.600357 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:57.600358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:57.600359 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:57.600363 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:57.600379 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:57.600383 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:57.600444 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:57.600524 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 07:20:57.600536 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:20:57.611975 13591 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:57.612726 13591 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:57.616698 13591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac4f2f6ef5e4485094944f7ef13c73c2: Generated new TSK 0
I20260811 07:20:57.616876 13591 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:57.619189 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 13457
W20260811 07:20:57.631008 13435 connection.cc:535] client connection to 127.0.0.1:45093 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45093): Connection reset by peer (error 104)
2026-08-11T07:20:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1597 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:57 dist-test-slave-7f01 krb5kdc[13633](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:57 dist-test-slave-7f01 krb5kdc[13633](info): set up 2 sockets
Aug 11 07:20:57 dist-test-slave-7f01 krb5kdc[13633](info): commencing operation
krb5kdc: starting...
W20260811 07:20:58.919283 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:20:59 dist-test-slave-7f01 krb5kdc[13633](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:20:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:20:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:20:59.050101 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42923
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:20:59.136832 13653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:20:59.137174 13653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:20:59.137212 13653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:20:59.138773 13653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:20:59.138849 13653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:20:59.138875 13653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:20:59.138903 13653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:20:59.138931 13653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:20:59.140475 13653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:20:59.140759 13653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:20:59.141000 13653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:20:59.145946 13662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:20:59.145983 13666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:59.146214 13653 server_base.cc:1034] running on GCE node
W20260811 07:20:59.145978 13661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:20:59.146526 13653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:20:59.146832 13653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:20:59.147984 13653 hybrid_clock.cc:648] HybridClock initialized: now 1786432859147958 us; error 35 us; skew 500 ppm
Aug 11 07:20:59 dist-test-slave-7f01 krb5kdc[13633](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432859, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:20:59.150501 13653 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:20:59.150967 13653 webserver.cc:460] Webserver started at http://127.0.0.1:34771/ using document root <none> and password file <none>
I20260811 07:20:59.151199 13653 fs_manager.cc:359] Metadata directory not provided
I20260811 07:20:59.151244 13653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:20:59.151415 13653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:20:59.152558 13653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "9806acdb18d54c0298448e1a78718d8f"
format_stamp: "Formatted at 2026-08-11 07:20:59 on dist-test-slave-7f01"
server_key: "be596c3a1334c1809e41828863c7a760"
server_key_iv: "a2a1c1547cbefb14dc0fa90611b5f305"
server_key_version: "encryptionkey@0"
I20260811 07:20:59.152926 13653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "9806acdb18d54c0298448e1a78718d8f"
format_stamp: "Formatted at 2026-08-11 07:20:59 on dist-test-slave-7f01"
server_key: "be596c3a1334c1809e41828863c7a760"
server_key_iv: "a2a1c1547cbefb14dc0fa90611b5f305"
server_key_version: "encryptionkey@0"
I20260811 07:20:59.154237 13653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 07:20:59.155186 13677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:20:59.155382 13653 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:20:59.155499 13653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "9806acdb18d54c0298448e1a78718d8f"
format_stamp: "Formatted at 2026-08-11 07:20:59 on dist-test-slave-7f01"
server_key: "be596c3a1334c1809e41828863c7a760"
server_key_iv: "a2a1c1547cbefb14dc0fa90611b5f305"
server_key_version: "encryptionkey@0"
I20260811 07:20:59.155586 13653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:20:59.158901 13653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:20:59.161154 13653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:20:59.161309 13653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:20:59.165643 13653 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42923
I20260811 07:20:59.165675 13771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42923 every 8 connection(s)
I20260811 07:20:59.166031 13653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:20:59.167028 13772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:20:59.169329 13772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f: Bootstrap starting.
I20260811 07:20:59.169930 13772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f: Neither blocks nor log segments found. Creating new log.
I20260811 07:20:59.170223 13772 log.cc:824] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:20:59.171029 13772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f: No bootstrap required, opened a new log
I20260811 07:20:59.172767 13772 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9806acdb18d54c0298448e1a78718d8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } }
I20260811 07:20:59.172941 13772 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:20:59.173012 13772 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9806acdb18d54c0298448e1a78718d8f, State: Initialized, Role: FOLLOWER
I20260811 07:20:59.173184 13772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9806acdb18d54c0298448e1a78718d8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } }
I20260811 07:20:59.173269 13772 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:20:59.173316 13772 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:20:59.173367 13772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:20:59.173897 13772 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9806acdb18d54c0298448e1a78718d8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } }
I20260811 07:20:59.174032 13772 leader_election.cc:302] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9806acdb18d54c0298448e1a78718d8f; no voters:
I20260811 07:20:59.174222 13772 leader_election.cc:288] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:20:59.174397 13776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:20:59.174487 13772 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:20:59.174574 13776 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [term 1 LEADER]: Becoming Leader. State: Replica: 9806acdb18d54c0298448e1a78718d8f, State: Running, Role: LEADER
I20260811 07:20:59.174667 13776 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9806acdb18d54c0298448e1a78718d8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } }
I20260811 07:20:59.175374 13779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9806acdb18d54c0298448e1a78718d8f. Latest consensus state: current_term: 1 leader_uuid: "9806acdb18d54c0298448e1a78718d8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9806acdb18d54c0298448e1a78718d8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } } }
I20260811 07:20:59.175567 13779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:59.175930 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 13653
I20260811 07:20:59.175968 13793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:20:59.176066 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:20:59.176308 9786 external_mini_cluster.cc:1428] Setting key 94734610391eebaab46ba8a249ed8d4a
I20260811 07:20:59.176303 13777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9806acdb18d54c0298448e1a78718d8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9806acdb18d54c0298448e1a78718d8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42923 } } }
I20260811 07:20:59.176620 13777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f [sys.catalog]: This master's current role is: LEADER
I20260811 07:20:59.176515 13793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:20:59.178375 13793 catalog_manager.cc:1347] Generated new cluster ID: a667629489814efabf612149b2248630
I20260811 07:20:59.178440 13793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:20:59.179098 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:59.177318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:57277 (local address 127.0.0.1:42923)
0811 07:20:59.177530 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:59.177539 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:59.177571 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:20:59.177683 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:59.177690 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:59.177731 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:59.177877 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:59.178613 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:59.178617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:59.178617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:59.178621 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:59.178666 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:59.178678 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:59.178747 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:59.178828 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 07:20:59.178963 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":85,"threads_started":1}
I20260811 07:20:59.180084 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:20:59.185482 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:20:59.184236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:46749 (local address 127.0.0.1:42923)
0811 07:20:59.184272 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 07:20:59.184274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:20:59.184425 (+ 151us) server_negotiation.cc:407] Connection header received
0811 07:20:59.184501 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:20:59.184502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:20:59.184506 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:20:59.184561 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:20:59.185157 (+ 596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:20:59.185158 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:20:59.185158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:20:59.185162 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:20:59.185177 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:20:59.185181 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:20:59.185234 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:20:59.185295 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 07:20:59.185311 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:20:59.223598 13793 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:20:59.223820 13793 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:20:59.239403 13793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9806acdb18d54c0298448e1a78718d8f: Generated new TSK 0
I20260811 07:20:59.239576 13793 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:20:59.248272 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 13653
2026-08-11T07:20:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1631 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:20:59 dist-test-slave-7f01 krb5kdc[13823](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:20:59 dist-test-slave-7f01 krb5kdc[13823](info): set up 2 sockets
Aug 11 07:20:59 dist-test-slave-7f01 krb5kdc[13823](info): commencing operation
krb5kdc: starting...
W20260811 07:21:00.533190 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:00 dist-test-slave-7f01 krb5kdc[13823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:21:00.662973 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42267
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42267
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:00.748471 13849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:00.748673 13849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:00.748696 13849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:00.749745 13849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:00.749784 13849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:00.749799 13849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:00.749812 13849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:00.749825 13849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:00.751214 13849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42267
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:00.751405 13849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:00.751582 13849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:21:00.756671 13849 server_base.cc:1034] running on GCE node
W20260811 07:21:00.756609 13857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:00.756613 13855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:00.756609 13860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:00.757172 13849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:00.757495 13849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:00.758651 13849 hybrid_clock.cc:648] HybridClock initialized: now 1786432860758635 us; error 28 us; skew 500 ppm
Aug 11 07:21:00 dist-test-slave-7f01 krb5kdc[13823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432860, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:00.761345 13849 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:21:00.761734 13849 webserver.cc:460] Webserver started at http://127.0.0.1:35193/ using document root <none> and password file <none>
I20260811 07:21:00.761950 13849 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:00.761993 13849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:00.762084 13849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:00.763106 13849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "7cf1d93e709546a3a0aefa768bc6315b"
format_stamp: "Formatted at 2026-08-11 07:21:00 on dist-test-slave-7f01"
server_key: "1be2650471993120b7a06c5064e7c629"
server_key_iv: "02b604c10b21e2afba38179f8dc48d60"
server_key_version: "encryptionkey@0"
I20260811 07:21:00.763417 13849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "7cf1d93e709546a3a0aefa768bc6315b"
format_stamp: "Formatted at 2026-08-11 07:21:00 on dist-test-slave-7f01"
server_key: "1be2650471993120b7a06c5064e7c629"
server_key_iv: "02b604c10b21e2afba38179f8dc48d60"
server_key_version: "encryptionkey@0"
I20260811 07:21:00.764860 13849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:21:00.765657 13872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:00.765856 13849 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:21:00.765998 13849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "7cf1d93e709546a3a0aefa768bc6315b"
format_stamp: "Formatted at 2026-08-11 07:21:00 on dist-test-slave-7f01"
server_key: "1be2650471993120b7a06c5064e7c629"
server_key_iv: "02b604c10b21e2afba38179f8dc48d60"
server_key_version: "encryptionkey@0"
I20260811 07:21:00.766081 13849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:00.784119 13849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:00.786572 13849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:00.786752 13849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:00.791427 13849 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42267
I20260811 07:21:00.791584 13946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42267 every 8 connection(s)
I20260811 07:21:00.791963 13849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:00.793149 13948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:00.795507 13948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b: Bootstrap starting.
I20260811 07:21:00.796167 13948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:00.796437 13948 log.cc:824] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:00.797201 13948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b: No bootstrap required, opened a new log
I20260811 07:21:00.798789 13948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf1d93e709546a3a0aefa768bc6315b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42267 } }
I20260811 07:21:00.798942 13948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:21:00.798969 13948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cf1d93e709546a3a0aefa768bc6315b, State: Initialized, Role: FOLLOWER
I20260811 07:21:00.799132 13948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf1d93e709546a3a0aefa768bc6315b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42267 } }
I20260811 07:21:00.799233 13948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:21:00.799273 13948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:21:00.799271 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 13849
I20260811 07:21:00.799333 13948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:00.799397 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:00.799623 9786 external_mini_cluster.cc:1428] Setting key 31c84f2e5bb31b0a9d8a467a4ecdec03
I20260811 07:21:00.800102 13948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf1d93e709546a3a0aefa768bc6315b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42267 } }
I20260811 07:21:00.800226 13948 leader_election.cc:302] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cf1d93e709546a3a0aefa768bc6315b; no voters:
I20260811 07:21:00.800508 13948 leader_election.cc:288] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:21:00.800534 13960 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:00.800745 13960 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [term 1 LEADER]: Becoming Leader. State: Replica: 7cf1d93e709546a3a0aefa768bc6315b, State: Running, Role: LEADER
I20260811 07:21:00.800832 13948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:00.800905 13960 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf1d93e709546a3a0aefa768bc6315b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42267 } }
I20260811 07:21:00.801358 13960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cf1d93e709546a3a0aefa768bc6315b. Latest consensus state: current_term: 1 leader_uuid: "7cf1d93e709546a3a0aefa768bc6315b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf1d93e709546a3a0aefa768bc6315b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42267 } } }
I20260811 07:21:00.801769 13960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:00.801689 13965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cf1d93e709546a3a0aefa768bc6315b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf1d93e709546a3a0aefa768bc6315b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42267 } } }
I20260811 07:21:00.802390 13965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:00.802657 13973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:00.803387 13973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:00.805070 13973 catalog_manager.cc:1347] Generated new cluster ID: e36728a38d3546b7bc17fade00654950
I20260811 07:21:00.805128 13973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 07:21:00 dist-test-slave-7f01 krb5kdc[13823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:21:00.810925 13973 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:00.811692 13973 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:00.812302 13953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:00.800185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:38121 (local address 127.0.0.1:42267)
0811 07:21:00.800515 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:00.800526 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:00.800573 (+ 47us) server_negotiation.cc:407] Connection header received
0811 07:21:00.800705 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:00.800738 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:00.800800 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:00.801882 (+ 1082us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:00.802097 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:00.803441 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:00.804427 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:00.805031 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:00.805526 (+ 495us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:00.808291 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:00.808305 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:00.808306 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:00.808318 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:00.810374 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:00.810962 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:00.810964 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:00.810965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:00.811092 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:00.811353 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:00.811353 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:00.811354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:00.811655 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:00.811872 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:00.811962 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 07:21:00.812071 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":184,"thread_start_us":90,"threads_started":1}
I20260811 07:21:00.813292 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:00.819816 13973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cf1d93e709546a3a0aefa768bc6315b: Generated new TSK 0
I20260811 07:21:00.820079 13973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:21:00.821920 13953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:00.815218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:46773 (local address 127.0.0.1:42267)
0811 07:21:00.815261 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:00.815263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:00.815398 (+ 135us) server_negotiation.cc:407] Connection header received
0811 07:21:00.815473 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:00.815474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:00.815484 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:00.815529 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:00.816146 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:00.816705 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:00.817471 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:00.817710 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:00.817782 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:00.819034 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:00.819035 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:00.819036 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:00.819042 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:00.820710 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:00.821104 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:00.821105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:00.821106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:00.821172 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:00.821404 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:00.821405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:00.821405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:00.821523 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:00.821640 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:00.821751 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 07:21:00.821814 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:21:00.824119 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 13849
W20260811 07:21:00.836835 13819 connection.cc:535] client connection to 127.0.0.1:42267 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42267): Connection reset by peer (error 104)
2026-08-11T07:21:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1574 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:00 dist-test-slave-7f01 krb5kdc[13999](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:00 dist-test-slave-7f01 krb5kdc[13999](info): set up 2 sockets
Aug 11 07:21:00 dist-test-slave-7f01 krb5kdc[13999](info): commencing operation
krb5kdc: starting...
W20260811 07:21:02.119652 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:02 dist-test-slave-7f01 krb5kdc[13999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432862, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:21:02.260205 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41129
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:02.344332 14026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:02.344554 14026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:02.344579 14026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:02.345649 14026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:02.345685 14026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:02.345700 14026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:02.345711 14026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:02.345723 14026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:02.347141 14026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41129
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:02.347344 14026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:02.347513 14026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:02.353024 14036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:02.353009 14035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:02.353012 14038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:02.353143 14026 server_base.cc:1034] running on GCE node
I20260811 07:21:02.353626 14026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:02.353955 14026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:02.355136 14026 hybrid_clock.cc:648] HybridClock initialized: now 1786432862355123 us; error 31 us; skew 500 ppm
Aug 11 07:21:02 dist-test-slave-7f01 krb5kdc[13999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432862, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:02.357714 14026 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:21:02.358208 14026 webserver.cc:460] Webserver started at http://127.0.0.1:41163/ using document root <none> and password file <none>
I20260811 07:21:02.358448 14026 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:02.358516 14026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:02.358673 14026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:02.359800 14026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "7ee103805e744512afdd578fc6575e64"
format_stamp: "Formatted at 2026-08-11 07:21:02 on dist-test-slave-7f01"
server_key: "0af8dfd1b1a853d73bbbab23fc04642b"
server_key_iv: "39ca5a3b836053cd1ceff0b718cb23ee"
server_key_version: "encryptionkey@0"
I20260811 07:21:02.360214 14026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "7ee103805e744512afdd578fc6575e64"
format_stamp: "Formatted at 2026-08-11 07:21:02 on dist-test-slave-7f01"
server_key: "0af8dfd1b1a853d73bbbab23fc04642b"
server_key_iv: "39ca5a3b836053cd1ceff0b718cb23ee"
server_key_version: "encryptionkey@0"
I20260811 07:21:02.361640 14026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:02.362511 14048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:02.362744 14026 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:02.362866 14026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "7ee103805e744512afdd578fc6575e64"
format_stamp: "Formatted at 2026-08-11 07:21:02 on dist-test-slave-7f01"
server_key: "0af8dfd1b1a853d73bbbab23fc04642b"
server_key_iv: "39ca5a3b836053cd1ceff0b718cb23ee"
server_key_version: "encryptionkey@0"
I20260811 07:21:02.362947 14026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:02.377238 14026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:02.379240 14026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:02.379559 14026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:02.384232 14026 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41129
I20260811 07:21:02.384266 14134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41129 every 8 connection(s)
I20260811 07:21:02.384651 14026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:02.385600 14136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:02.386668 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14026
I20260811 07:21:02.386785 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:02.387028 9786 external_mini_cluster.cc:1428] Setting key 20d2f5fb9b8279fd11918109d62e4e01
I20260811 07:21:02.388595 14136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64: Bootstrap starting.
I20260811 07:21:02.389228 14136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:02.389544 14136 log.cc:824] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:02.390277 14136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64: No bootstrap required, opened a new log
I20260811 07:21:02.392339 14136 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee103805e744512afdd578fc6575e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } }
I20260811 07:21:02.392513 14136 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:21:02.392565 14136 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee103805e744512afdd578fc6575e64, State: Initialized, Role: FOLLOWER
I20260811 07:21:02.392743 14136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee103805e744512afdd578fc6575e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } }
I20260811 07:21:02.392845 14136 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:21:02.392908 14136 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:21:02.392966 14136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:02.393137 14139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:02.387859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:34837 (local address 127.0.0.1:41129)
0811 07:21:02.388162 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:02.388171 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:02.388204 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:21:02.388637 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:02.388644 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:02.388734 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:02.388933 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:02.389165 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:02.390168 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:02.391015 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:02.391450 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:02.391572 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:02.392378 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:02.392383 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:02.392383 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:02.392579 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:02.392620 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:02.392640 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:02.392738 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:02.392820 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 07:21:02.392850 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":83,"threads_started":1}
I20260811 07:21:02.393712 14136 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee103805e744512afdd578fc6575e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } }
I20260811 07:21:02.393827 14136 leader_election.cc:302] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ee103805e744512afdd578fc6575e64; no voters:
I20260811 07:21:02.394006 14136 leader_election.cc:288] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:21:02.394055 14142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:02.394223 14142 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [term 1 LEADER]: Becoming Leader. State: Replica: 7ee103805e744512afdd578fc6575e64, State: Running, Role: LEADER
I20260811 07:21:02.394261 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:02.394332 14136 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:02.394383 14142 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee103805e744512afdd578fc6575e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } }
I20260811 07:21:02.394707 14142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ee103805e744512afdd578fc6575e64. Latest consensus state: current_term: 1 leader_uuid: "7ee103805e744512afdd578fc6575e64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee103805e744512afdd578fc6575e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } } }
I20260811 07:21:02.394778 14142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:02.394938 14143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ee103805e744512afdd578fc6575e64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee103805e744512afdd578fc6575e64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41129 } } }
I20260811 07:21:02.394984 14143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:02.395097 14154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:02.395614 14154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:02.397598 14154 catalog_manager.cc:1347] Generated new cluster ID: 46df61fbc3b14b40bcee9b891cd5a00c
I20260811 07:21:02.397692 14154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:02.399819 14139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:02.396023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:36771 (local address 127.0.0.1:41129)
0811 07:21:02.396061 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:02.396063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:02.396284 (+ 221us) server_negotiation.cc:407] Connection header received
0811 07:21:02.396389 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:02.396390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:02.396402 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:02.396435 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:02.396668 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:02.397323 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:02.398345 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:02.398650 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:02.398733 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:02.399525 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:02.399526 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:02.399527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:02.399531 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:02.399549 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:02.399555 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:02.399623 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:02.399705 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 07:21:02.399716 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 07:21:02.404902 14154 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:02.405443 14154 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:02.413301 14154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ee103805e744512afdd578fc6575e64: Generated new TSK 0
I20260811 07:21:02.413535 14154 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:21:02.420507 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14026
W20260811 07:21:02.433269 13997 connection.cc:535] client connection to 127.0.0.1:41129 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41129): Connection reset by peer (error 104)
2026-08-11T07:21:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1595 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:02 dist-test-slave-7f01 krb5kdc[14195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:02 dist-test-slave-7f01 krb5kdc[14195](info): set up 2 sockets
Aug 11 07:21:02 dist-test-slave-7f01 krb5kdc[14195](info): commencing operation
krb5kdc: starting...
W20260811 07:21:03.718783 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:03 dist-test-slave-7f01 krb5kdc[14195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:21:03.858848 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40721
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:03.952484 14225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:03.952724 14225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:03.952760 14225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:03.953882 14225 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:03.953958 14225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:03.953984 14225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:03.954025 14225 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:03.954052 14225 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:03.955514 14225 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40721
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:03.955825 14225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:03.956074 14225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:03.961272 14242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:03.961329 14236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:03.961287 14233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:03.961637 14225 server_base.cc:1034] running on GCE node
I20260811 07:21:03.961903 14225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:03.962248 14225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:03.963407 14225 hybrid_clock.cc:648] HybridClock initialized: now 1786432863963394 us; error 33 us; skew 500 ppm
Aug 11 07:21:03 dist-test-slave-7f01 krb5kdc[14195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432863, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:03.970422 14225 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:21:03.970878 14225 webserver.cc:460] Webserver started at http://127.0.0.1:35329/ using document root <none> and password file <none>
I20260811 07:21:03.971149 14225 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:03.971220 14225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:03.971551 14225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:03.972762 14225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "0f34d1a5c0a541d1be76d1b8cfb093db"
format_stamp: "Formatted at 2026-08-11 07:21:03 on dist-test-slave-7f01"
server_key: "09d0746a9bae6e4946945a435c969dbe"
server_key_iv: "df8bedc4b5a1d36f9d9f26ffbc912476"
server_key_version: "encryptionkey@0"
I20260811 07:21:03.973147 14225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "0f34d1a5c0a541d1be76d1b8cfb093db"
format_stamp: "Formatted at 2026-08-11 07:21:03 on dist-test-slave-7f01"
server_key: "09d0746a9bae6e4946945a435c969dbe"
server_key_iv: "df8bedc4b5a1d36f9d9f26ffbc912476"
server_key_version: "encryptionkey@0"
I20260811 07:21:03.974623 14225 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:21:03.975409 14254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:03.975610 14225 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:03.975709 14225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "0f34d1a5c0a541d1be76d1b8cfb093db"
format_stamp: "Formatted at 2026-08-11 07:21:03 on dist-test-slave-7f01"
server_key: "09d0746a9bae6e4946945a435c969dbe"
server_key_iv: "df8bedc4b5a1d36f9d9f26ffbc912476"
server_key_version: "encryptionkey@0"
I20260811 07:21:03.975841 14225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:03.979132 14225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:03.981268 14225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:03.981441 14225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:03.985927 14225 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40721
I20260811 07:21:03.985965 14335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40721 every 8 connection(s)
I20260811 07:21:03.986323 14225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:03.987428 14336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:03.989787 14336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db: Bootstrap starting.
I20260811 07:21:03.990342 14336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:03.990603 14336 log.cc:824] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:03.991282 14336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db: No bootstrap required, opened a new log
I20260811 07:21:03.992957 14336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f34d1a5c0a541d1be76d1b8cfb093db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } }
I20260811 07:21:03.993100 14336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:21:03.993124 14336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f34d1a5c0a541d1be76d1b8cfb093db, State: Initialized, Role: FOLLOWER
I20260811 07:21:03.993263 14336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f34d1a5c0a541d1be76d1b8cfb093db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } }
I20260811 07:21:03.993345 14336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:21:03.993368 14336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:21:03.993485 14336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:03.993999 14336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f34d1a5c0a541d1be76d1b8cfb093db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } }
I20260811 07:21:03.994089 14336 leader_election.cc:302] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f34d1a5c0a541d1be76d1b8cfb093db; no voters:
I20260811 07:21:03.994223 14336 leader_election.cc:288] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:21:03.994315 14343 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:03.994462 14336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:03.994832 14343 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [term 1 LEADER]: Becoming Leader. State: Replica: 0f34d1a5c0a541d1be76d1b8cfb093db, State: Running, Role: LEADER
I20260811 07:21:03.995009 14343 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f34d1a5c0a541d1be76d1b8cfb093db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } }
I20260811 07:21:03.995013 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14225
I20260811 07:21:03.995144 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:03.995395 9786 external_mini_cluster.cc:1428] Setting key 23fa5e40b18444636cbe706976bcb794
I20260811 07:21:03.996062 14348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f34d1a5c0a541d1be76d1b8cfb093db. Latest consensus state: current_term: 1 leader_uuid: "0f34d1a5c0a541d1be76d1b8cfb093db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f34d1a5c0a541d1be76d1b8cfb093db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } } }
I20260811 07:21:03.996150 14348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:03.996825 14347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f34d1a5c0a541d1be76d1b8cfb093db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f34d1a5c0a541d1be76d1b8cfb093db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40721 } } }
I20260811 07:21:03.997124 14347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db [sys.catalog]: This master's current role is: LEADER
W20260811 07:21:03.997228 14386 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:21:03.997300 14386 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:21:03.997397 14382 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:03.997586 14382 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:03.998620 14371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:03.996097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:59237 (local address 127.0.0.1:40721)
0811 07:21:03.996286 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:03.996296 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:03.996328 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:21:03.996446 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:03.996455 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:03.996493 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:03.996655 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:03.997876 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:03.997880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:03.997881 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:03.997885 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:03.997942 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:03.997953 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:03.998048 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:03.998121 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 07:21:03.998168 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":78,"threads_started":1}
I20260811 07:21:03.999275 14382 catalog_manager.cc:1347] Generated new cluster ID: ca7cb2ea50ce4531ba02c56329ec220e
I20260811 07:21:03.999483 14382 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:03.999589 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:04.002166 14371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:04.001072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.49:55707 (local address 127.0.0.1:40721)
0811 07:21:04.001109 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:04.001111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:04.001236 (+ 125us) server_negotiation.cc:407] Connection header received
0811 07:21:04.001302 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:04.001303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:04.001308 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:04.001363 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:04.001967 (+ 604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:04.001968 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:04.001969 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:04.001973 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:04.001987 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:04.001991 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:04.002040 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:04.002084 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 07:21:04.002099 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:21:04.012349 14382 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:04.012547 14382 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:04.021098 14382 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f34d1a5c0a541d1be76d1b8cfb093db: Generated new TSK 0
I20260811 07:21:04.021313 14382 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:21:04.026365 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14225
2026-08-11T07:21:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:04 dist-test-slave-7f01 krb5kdc[14407](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:04 dist-test-slave-7f01 krb5kdc[14407](info): set up 2 sockets
Aug 11 07:21:04 dist-test-slave-7f01 krb5kdc[14407](info): commencing operation
krb5kdc: starting...
W20260811 07:21:05.323007 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:05 dist-test-slave-7f01 krb5kdc[14407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:21:05.459350 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:43181
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:40475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:43181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:05.542821 14428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:05.543018 14428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:05.543040 14428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:05.544198 14428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:05.544250 14428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:05.544263 14428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:05.544276 14428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:05.544288 14428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:05.545744 14428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:40475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:43181
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:43181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:05.546008 14428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:05.546247 14428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:05.551098 14444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:05.551200 14442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:05.551313 14428 server_base.cc:1034] running on GCE node
W20260811 07:21:05.551200 14440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:05.551710 14428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:05.552068 14428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:05.553232 14428 hybrid_clock.cc:648] HybridClock initialized: now 1786432865553230 us; error 37 us; skew 500 ppm
Aug 11 07:21:05 dist-test-slave-7f01 krb5kdc[14407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432865, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:05.555698 14428 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:21:05.556205 14428 webserver.cc:460] Webserver started at http://127.9.142.190:44061/ using document root <none> and password file <none>
I20260811 07:21:05.556456 14428 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:05.556546 14428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:05.556681 14428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:05.558061 14428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "0842bd34cf134f6d91e70eebc0f1fe81"
format_stamp: "Formatted at 2026-08-11 07:21:05 on dist-test-slave-7f01"
server_key: "49543c2a0ac28fb806cbbe950c496fad"
server_key_iv: "7e2ebf8c5211d0ad1d25e855598c7af4"
server_key_version: "encryptionkey@0"
I20260811 07:21:05.558358 14428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "0842bd34cf134f6d91e70eebc0f1fe81"
format_stamp: "Formatted at 2026-08-11 07:21:05 on dist-test-slave-7f01"
server_key: "49543c2a0ac28fb806cbbe950c496fad"
server_key_iv: "7e2ebf8c5211d0ad1d25e855598c7af4"
server_key_version: "encryptionkey@0"
I20260811 07:21:05.559686 14428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:21:05.560500 14454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:05.560691 14428 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:21:05.560806 14428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "0842bd34cf134f6d91e70eebc0f1fe81"
format_stamp: "Formatted at 2026-08-11 07:21:05 on dist-test-slave-7f01"
server_key: "49543c2a0ac28fb806cbbe950c496fad"
server_key_iv: "7e2ebf8c5211d0ad1d25e855598c7af4"
server_key_version: "encryptionkey@0"
I20260811 07:21:05.560885 14428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:05.582120 14428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:05.587589 14428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:05.587805 14428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:05.593287 14428 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:43181
I20260811 07:21:05.593329 14545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:43181 every 8 connection(s)
I20260811 07:21:05.593818 14428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:05.594882 14548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:05.597942 14548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81: Bootstrap starting.
I20260811 07:21:05.598230 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14428
I20260811 07:21:05.598356 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:05.598577 9786 external_mini_cluster.cc:1428] Setting key 637e160020e8a5922ce194bf26634587
I20260811 07:21:05.598819 14548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:05.599128 14548 log.cc:824] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:05.599967 14548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81: No bootstrap required, opened a new log
I20260811 07:21:05.603005 14548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0842bd34cf134f6d91e70eebc0f1fe81" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43181 } }
I20260811 07:21:05.603185 14548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:21:05.603268 14548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0842bd34cf134f6d91e70eebc0f1fe81, State: Initialized, Role: FOLLOWER
I20260811 07:21:05.603410 14548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0842bd34cf134f6d91e70eebc0f1fe81" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43181 } }
I20260811 07:21:05.603500 14548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:21:05.603574 14548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:21:05.603633 14548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:05.604382 14548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0842bd34cf134f6d91e70eebc0f1fe81" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43181 } }
I20260811 07:21:05.604512 14548 leader_election.cc:302] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0842bd34cf134f6d91e70eebc0f1fe81; no voters:
I20260811 07:21:05.604686 14548 leader_election.cc:288] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:21:05.604740 14563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:05.604974 14563 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [term 1 LEADER]: Becoming Leader. State: Replica: 0842bd34cf134f6d91e70eebc0f1fe81, State: Running, Role: LEADER
I20260811 07:21:05.605079 14548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:05.605113 14563 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0842bd34cf134f6d91e70eebc0f1fe81" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43181 } }
I20260811 07:21:05.605610 14565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0842bd34cf134f6d91e70eebc0f1fe81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0842bd34cf134f6d91e70eebc0f1fe81" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43181 } } }
I20260811 07:21:05.605852 14565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:05.605763 14567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0842bd34cf134f6d91e70eebc0f1fe81. Latest consensus state: current_term: 1 leader_uuid: "0842bd34cf134f6d91e70eebc0f1fe81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0842bd34cf134f6d91e70eebc0f1fe81" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43181 } } }
I20260811 07:21:05.606120 14567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:05.606490 14579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 07:21:05 dist-test-slave-7f01 krb5kdc[14407](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:21:05.607064 14579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:05.611167 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:05.599323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49143 (local address 127.9.142.190:43181)
0811 07:21:05.599463 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:05.599472 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:05.599508 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:21:05.600146 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:05.600156 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:05.600216 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:05.600381 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:05.601008 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:05.602417 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:05.603555 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:05.604226 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:05.604692 (+ 466us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:05.607824 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:05.607828 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:05.607829 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:05.607852 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:05.609570 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:05.609979 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:05.609982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:05.609982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:05.610077 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:05.610322 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:05.610323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:05.610323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:05.610561 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:05.610772 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:05.610888 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 07:21:05.611001 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":65,"threads_started":1}
I20260811 07:21:05.612325 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:05.616180 14579 catalog_manager.cc:1347] Generated new cluster ID: 8236a656b16f492c96625e1e8a1b031f
I20260811 07:21:05.616238 14579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:05.620937 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:05.613779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59089 (local address 127.9.142.190:43181)
0811 07:21:05.613825 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:05.613827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:05.613854 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:21:05.613910 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:05.613910 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:05.613920 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:05.613974 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:05.614482 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:05.615208 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:05.615997 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:05.616364 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:05.616454 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:05.617978 (+ 1524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:05.617980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:05.617980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:05.617988 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:05.619465 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:05.619947 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:05.619948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:05.619949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:05.620012 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:05.620253 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:05.620254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:05.620254 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:05.620390 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:05.620490 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:05.620744 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 07:21:05.620821 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:21:05.632074 14579 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:05.632782 14579 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:05.637190 14579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0842bd34cf134f6d91e70eebc0f1fe81: Generated new TSK 0
I20260811 07:21:05.637375 14579 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:21:05.640793 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14428
W20260811 07:21:05.655643 14405 connection.cc:535] client connection to 127.9.142.190:43181 recv error: Network error: failed to read from TLS socket (remote: 127.9.142.190:43181): Connection reset by peer (error 104)
2026-08-11T07:21:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:05 dist-test-slave-7f01 krb5kdc[14616](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:05 dist-test-slave-7f01 krb5kdc[14616](info): set up 2 sockets
Aug 11 07:21:05 dist-test-slave-7f01 krb5kdc[14616](info): commencing operation
krb5kdc: starting...
W20260811 07:21:06.938274 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:07 dist-test-slave-7f01 krb5kdc[14616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:21:07.067114 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:46517
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:46475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:46517
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:07.151541 14645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:07.151814 14645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:07.151858 14645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:07.153007 14645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:07.153077 14645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:07.153102 14645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:07.153131 14645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:07.153163 14645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:07.154627 14645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:46475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:46517
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:46517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:07.154918 14645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:07.155150 14645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:07.160058 14657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:07.160117 14653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:07.160058 14655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:07.160219 14645 server_base.cc:1034] running on GCE node
I20260811 07:21:07.160601 14645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:07.160907 14645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:07.162083 14645 hybrid_clock.cc:648] HybridClock initialized: now 1786432867162076 us; error 37 us; skew 500 ppm
Aug 11 07:21:07 dist-test-slave-7f01 krb5kdc[14616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432867, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:07.164680 14645 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:21:07.165149 14645 webserver.cc:460] Webserver started at http://127.9.142.190:46109/ using document root <none> and password file <none>
I20260811 07:21:07.165401 14645 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:07.165472 14645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:07.165620 14645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:07.166651 14645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "8582c8c274f1477da402a87a3801267a"
format_stamp: "Formatted at 2026-08-11 07:21:07 on dist-test-slave-7f01"
server_key: "13508371b60501179d5a91214b5600c0"
server_key_iv: "6c32a2b262fb48f6484931afcaa3d9fe"
server_key_version: "encryptionkey@0"
I20260811 07:21:07.167034 14645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "8582c8c274f1477da402a87a3801267a"
format_stamp: "Formatted at 2026-08-11 07:21:07 on dist-test-slave-7f01"
server_key: "13508371b60501179d5a91214b5600c0"
server_key_iv: "6c32a2b262fb48f6484931afcaa3d9fe"
server_key_version: "encryptionkey@0"
I20260811 07:21:07.168467 14645 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:21:07.169214 14674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:07.169396 14645 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 07:21:07.169510 14645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "8582c8c274f1477da402a87a3801267a"
format_stamp: "Formatted at 2026-08-11 07:21:07 on dist-test-slave-7f01"
server_key: "13508371b60501179d5a91214b5600c0"
server_key_iv: "6c32a2b262fb48f6484931afcaa3d9fe"
server_key_version: "encryptionkey@0"
I20260811 07:21:07.169587 14645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:07.199810 14645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:07.202356 14645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:07.202535 14645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:07.207010 14645 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:46517
I20260811 07:21:07.207053 14763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:46517 every 8 connection(s)
I20260811 07:21:07.207472 14645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:07.208454 14765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:07.210798 14765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a: Bootstrap starting.
I20260811 07:21:07.211365 14765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:07.211609 14765 log.cc:824] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:07.212381 14765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a: No bootstrap required, opened a new log
I20260811 07:21:07.213241 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14645
I20260811 07:21:07.213367 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:07.213613 9786 external_mini_cluster.cc:1428] Setting key 397aa95b9c2f2b3db770bb0b617c2aea
I20260811 07:21:07.214613 14765 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8582c8c274f1477da402a87a3801267a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46517 } }
I20260811 07:21:07.214805 14765 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:21:07.214851 14765 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8582c8c274f1477da402a87a3801267a, State: Initialized, Role: FOLLOWER
I20260811 07:21:07.215003 14765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8582c8c274f1477da402a87a3801267a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46517 } }
I20260811 07:21:07.215098 14765 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:21:07.215140 14765 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:21:07.215185 14765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:07.215960 14765 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8582c8c274f1477da402a87a3801267a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46517 } }
I20260811 07:21:07.216077 14765 leader_election.cc:302] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8582c8c274f1477da402a87a3801267a; no voters:
I20260811 07:21:07.216233 14765 leader_election.cc:288] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:21:07.216326 14778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:07.216500 14778 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [term 1 LEADER]: Becoming Leader. State: Replica: 8582c8c274f1477da402a87a3801267a, State: Running, Role: LEADER
I20260811 07:21:07.216550 14765 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:07.216658 14778 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8582c8c274f1477da402a87a3801267a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46517 } }
I20260811 07:21:07.217123 14782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8582c8c274f1477da402a87a3801267a. Latest consensus state: current_term: 1 leader_uuid: "8582c8c274f1477da402a87a3801267a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8582c8c274f1477da402a87a3801267a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46517 } } }
I20260811 07:21:07.217133 14779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8582c8c274f1477da402a87a3801267a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8582c8c274f1477da402a87a3801267a" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 46517 } } }
I20260811 07:21:07.217243 14782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:07.217245 14779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:07.218111 14795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:07.218629 14795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:07.220185 14776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:07.214200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57711 (local address 127.9.142.190:46517)
0811 07:21:07.214391 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:07.214399 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:07.214430 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:21:07.214570 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:07.214575 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:07.214618 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:07.214726 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:07.215011 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:07.216780 (+ 1769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:07.218000 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:07.218556 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:07.218692 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:07.219447 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:07.219451 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:07.219451 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:07.219629 (+ 178us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:07.219661 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:07.219671 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:07.219794 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:07.219883 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 07:21:07.219913 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260811 07:21:07.220256 14795 catalog_manager.cc:1347] Generated new cluster ID: 02fabb20a18d4b098ef5be1d98f9f176
I20260811 07:21:07.220360 14795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:07.221290 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:07.231180 14776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:07.228130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58943 (local address 127.9.142.190:46517)
0811 07:21:07.228178 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:07.228181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:07.228336 (+ 155us) server_negotiation.cc:407] Connection header received
0811 07:21:07.228416 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:07.228417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:07.228428 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:07.228473 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:07.228630 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:07.229121 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:07.229847 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:07.230072 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:07.230162 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:07.230912 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:07.230913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:07.230914 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:07.230918 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:07.230934 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:07.230938 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:07.230995 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:07.231072 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 07:21:07.231084 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:21:07.238093 14795 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:07.238936 14795 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:07.251765 14795 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8582c8c274f1477da402a87a3801267a: Generated new TSK 0
I20260811 07:21:07.252000 14795 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:21:07.255753 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14645
W20260811 07:21:07.269124 14612 connection.cc:535] client connection to 127.9.142.190:46517 recv error: Network error: failed to read from TLS socket (remote: 127.9.142.190:46517): Connection reset by peer (error 104)
2026-08-11T07:21:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1612 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:07 dist-test-slave-7f01 krb5kdc[14824](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:07 dist-test-slave-7f01 krb5kdc[14824](info): set up 2 sockets
Aug 11 07:21:07 dist-test-slave-7f01 krb5kdc[14824](info): commencing operation
krb5kdc: starting...
W20260811 07:21:08.552244 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:08 dist-test-slave-7f01 krb5kdc[14824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:21:08.687497 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:43251
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:36213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:43251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:08.779605 14842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:08.779907 14842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:08.779950 14842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:08.781131 14842 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:08.781201 14842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:08.781227 14842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:08.781258 14842 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:08.781281 14842 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:08.782858 14842 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:36213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:43251
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:43251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:08.783150 14842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:08.783396 14842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:08.788710 14851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:08.788843 14854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:08.788734 14849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:08.789079 14842 server_base.cc:1034] running on GCE node
I20260811 07:21:08.789335 14842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:08.789947 14842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:08.791174 14842 hybrid_clock.cc:648] HybridClock initialized: now 1786432868791153 us; error 32 us; skew 500 ppm
Aug 11 07:21:08 dist-test-slave-7f01 krb5kdc[14824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432868, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:08.794175 14842 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:21:08.795127 14842 webserver.cc:460] Webserver started at http://127.9.142.190:46071/ using document root <none> and password file <none>
I20260811 07:21:08.795421 14842 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:08.795501 14842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:08.795673 14842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:08.797006 14842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "b4b9bdd64cd4466da217ab91ad787532"
format_stamp: "Formatted at 2026-08-11 07:21:08 on dist-test-slave-7f01"
server_key: "812324e7f2c6dba6b44380410bdc63fa"
server_key_iv: "879da67b8c8518cb3735c91192aed1d0"
server_key_version: "encryptionkey@0"
I20260811 07:21:08.797439 14842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "b4b9bdd64cd4466da217ab91ad787532"
format_stamp: "Formatted at 2026-08-11 07:21:08 on dist-test-slave-7f01"
server_key: "812324e7f2c6dba6b44380410bdc63fa"
server_key_iv: "879da67b8c8518cb3735c91192aed1d0"
server_key_version: "encryptionkey@0"
I20260811 07:21:08.799109 14842 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 07:21:08.800117 14871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:08.800341 14842 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:08.800578 14842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "b4b9bdd64cd4466da217ab91ad787532"
format_stamp: "Formatted at 2026-08-11 07:21:08 on dist-test-slave-7f01"
server_key: "812324e7f2c6dba6b44380410bdc63fa"
server_key_iv: "879da67b8c8518cb3735c91192aed1d0"
server_key_version: "encryptionkey@0"
I20260811 07:21:08.800681 14842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:08.804549 14842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:08.807194 14842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:08.807380 14842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:08.811832 14842 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:43251
I20260811 07:21:08.811874 14964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:43251 every 8 connection(s)
I20260811 07:21:08.812243 14842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:08.813295 14965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:08.814874 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 14842
I20260811 07:21:08.815011 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:08.815235 9786 external_mini_cluster.cc:1428] Setting key ab090ecdd8ecf18c9e69aa6b21f649d0
I20260811 07:21:08.816139 14965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532: Bootstrap starting.
I20260811 07:21:08.816890 14965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:08.817242 14965 log.cc:824] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:08.818140 14965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532: No bootstrap required, opened a new log
I20260811 07:21:08.818248 14971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:08.815912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48965 (local address 127.9.142.190:43251)
0811 07:21:08.816124 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:08.816134 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:08.816167 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:21:08.816777 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:08.816786 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:08.816819 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:08.816989 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:08.817724 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:08.817729 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:08.817729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:08.817734 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:08.817783 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:08.817797 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:08.817885 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:08.817964 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 07:21:08.818016 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":98,"threads_started":1}
I20260811 07:21:08.819375 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:08.820894 14965 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b9bdd64cd4466da217ab91ad787532" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43251 } }
I20260811 07:21:08.821139 14965 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:21:08.821200 14965 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9bdd64cd4466da217ab91ad787532, State: Initialized, Role: FOLLOWER
I20260811 07:21:08.821345 14965 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b9bdd64cd4466da217ab91ad787532" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43251 } }
I20260811 07:21:08.821465 14965 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:21:08.821502 14965 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:21:08.821554 14965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:08.822274 14971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:08.821156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37543 (local address 127.9.142.190:43251)
0811 07:21:08.821201 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:08.821203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:08.821322 (+ 119us) server_negotiation.cc:407] Connection header received
0811 07:21:08.821417 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:08.821417 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:08.821422 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:08.821505 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:08.822103 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:08.822104 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:08.822105 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:08.822108 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:08.822121 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:08.822125 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:08.822165 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:08.822221 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 07:21:08.822232 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:21:08.822341 14965 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b9bdd64cd4466da217ab91ad787532" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43251 } }
I20260811 07:21:08.822448 14965 leader_election.cc:302] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4b9bdd64cd4466da217ab91ad787532; no voters:
I20260811 07:21:08.822613 14965 leader_election.cc:288] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:21:08.822638 14982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:08.822845 14982 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [term 1 LEADER]: Becoming Leader. State: Replica: b4b9bdd64cd4466da217ab91ad787532, State: Running, Role: LEADER
I20260811 07:21:08.822942 14965 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:08.823035 14982 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b9bdd64cd4466da217ab91ad787532" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43251 } }
I20260811 07:21:08.823426 14982 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4b9bdd64cd4466da217ab91ad787532. Latest consensus state: current_term: 1 leader_uuid: "b4b9bdd64cd4466da217ab91ad787532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b9bdd64cd4466da217ab91ad787532" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43251 } } }
I20260811 07:21:08.823524 14982 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:08.823441 14984 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4b9bdd64cd4466da217ab91ad787532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b9bdd64cd4466da217ab91ad787532" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43251 } } }
I20260811 07:21:08.823717 14984 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:08.823839 14988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:08.824389 14988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:08.826489 14988 catalog_manager.cc:1347] Generated new cluster ID: 849d1af2a5574b5488ad31f5a567ba90
I20260811 07:21:08.826565 14988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:08.838491 14988 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:08.838692 14988 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:08.843822 14988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4b9bdd64cd4466da217ab91ad787532: Generated new TSK 0
I20260811 07:21:08.844058 14988 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:21:08.851619 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 14842
2026-08-11T07:21:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1600 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:08 dist-test-slave-7f01 krb5kdc[15008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:08 dist-test-slave-7f01 krb5kdc[15008](info): set up 2 sockets
Aug 11 07:21:08 dist-test-slave-7f01 krb5kdc[15008](info): commencing operation
krb5kdc: starting...
W20260811 07:21:10.159078 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:10 dist-test-slave-7f01 krb5kdc[15008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:21:10.295929 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41893
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:41893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:10.387569 15031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:10.387903 15031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:10.387948 15031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:10.389242 15031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:10.389307 15031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:10.389331 15031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:10.389359 15031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:10.389386 15031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:10.390868 15031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:41893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:10.391158 15031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:10.391398 15031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:10.396566 15038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:10.396631 15036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:10.396631 15043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:10.396936 15031 server_base.cc:1034] running on GCE node
I20260811 07:21:10.397214 15031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:10.397516 15031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:10.398705 15031 hybrid_clock.cc:648] HybridClock initialized: now 1786432870398670 us; error 38 us; skew 500 ppm
Aug 11 07:21:10 dist-test-slave-7f01 krb5kdc[15008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432870, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:10.404304 15031 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:21:10.404793 15031 webserver.cc:460] Webserver started at http://127.9.142.190:36977/ using document root <none> and password file <none>
I20260811 07:21:10.405059 15031 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:10.405134 15031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:10.405293 15031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:10.406621 15031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "5b7b2b13ae9c4c74aa1308142572a139"
format_stamp: "Formatted at 2026-08-11 07:21:10 on dist-test-slave-7f01"
server_key: "ed1f13e2628539ef71d1cf11bcbb300d"
server_key_iv: "e391512dee2e0028c5627a6532b55081"
server_key_version: "encryptionkey@0"
I20260811 07:21:10.407064 15031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "5b7b2b13ae9c4c74aa1308142572a139"
format_stamp: "Formatted at 2026-08-11 07:21:10 on dist-test-slave-7f01"
server_key: "ed1f13e2628539ef71d1cf11bcbb300d"
server_key_iv: "e391512dee2e0028c5627a6532b55081"
server_key_version: "encryptionkey@0"
I20260811 07:21:10.408565 15031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 07:21:10.409333 15052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:10.409665 15031 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:10.409780 15031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "5b7b2b13ae9c4c74aa1308142572a139"
format_stamp: "Formatted at 2026-08-11 07:21:10 on dist-test-slave-7f01"
server_key: "ed1f13e2628539ef71d1cf11bcbb300d"
server_key_iv: "e391512dee2e0028c5627a6532b55081"
server_key_version: "encryptionkey@0"
I20260811 07:21:10.409857 15031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:10.433180 15031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:10.436112 15031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:10.436285 15031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:10.440732 15031 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:41893
I20260811 07:21:10.440783 15145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:41893 every 8 connection(s)
I20260811 07:21:10.441169 15031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:10.442149 15146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:10.442817 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15031
I20260811 07:21:10.442950 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:10.443157 9786 external_mini_cluster.cc:1428] Setting key c73539c848af13c55bfbe53b96911a27
I20260811 07:21:10.445721 15146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139: Bootstrap starting.
I20260811 07:21:10.446415 15146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:10.446732 15146 log.cc:824] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:10.447595 15146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139: No bootstrap required, opened a new log
Aug 11 07:21:10 dist-test-slave-7f01 krb5kdc[15008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:21:10.449967 15146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7b2b13ae9c4c74aa1308142572a139" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41893 } }
I20260811 07:21:10.450165 15146 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:21:10.450240 15146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7b2b13ae9c4c74aa1308142572a139, State: Initialized, Role: FOLLOWER
I20260811 07:21:10.450376 15146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7b2b13ae9c4c74aa1308142572a139" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41893 } }
I20260811 07:21:10.450443 15146 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:21:10.450466 15146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:21:10.450541 15146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:10.451316 15146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7b2b13ae9c4c74aa1308142572a139" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41893 } }
I20260811 07:21:10.451442 15146 leader_election.cc:302] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b7b2b13ae9c4c74aa1308142572a139; no voters:
I20260811 07:21:10.451637 15146 leader_election.cc:288] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:21:10.451704 15154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:10.451934 15146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:10.451913 15154 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [term 1 LEADER]: Becoming Leader. State: Replica: 5b7b2b13ae9c4c74aa1308142572a139, State: Running, Role: LEADER
I20260811 07:21:10.452142 15154 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7b2b13ae9c4c74aa1308142572a139" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41893 } }
I20260811 07:21:10.452862 15157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b7b2b13ae9c4c74aa1308142572a139. Latest consensus state: current_term: 1 leader_uuid: "5b7b2b13ae9c4c74aa1308142572a139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7b2b13ae9c4c74aa1308142572a139" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41893 } } }
I20260811 07:21:10.452984 15157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:10.453047 15156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b7b2b13ae9c4c74aa1308142572a139" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7b2b13ae9c4c74aa1308142572a139" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41893 } } }
I20260811 07:21:10.453125 15156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139 [sys.catalog]: This master's current role is: LEADER
W20260811 07:21:10.454051 15177 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:21:10.454151 15177 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:21:10.454408 15169 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:10.454578 15169 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:10.454603 15151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:10.443784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45985 (local address 127.9.142.190:41893)
0811 07:21:10.443979 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:10.443987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:10.444013 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:21:10.444440 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:10.444447 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:10.444491 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:10.444604 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:10.445481 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:10.446480 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:10.447298 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:10.447732 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:10.447863 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:10.450649 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:10.450653 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:10.450653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:10.450666 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:10.452745 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:10.453211 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:10.453215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:10.453215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:10.453338 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:10.453613 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:10.453614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:10.453614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:10.453930 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:10.454123 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:10.454243 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 07:21:10.454380 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260811 07:21:10.455653 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:10.456374 15169 catalog_manager.cc:1347] Generated new cluster ID: cef8732287894bd08e0090f244be3427
I20260811 07:21:10.456430 15169 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:10.464982 15151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:10.457555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59003 (local address 127.9.142.190:41893)
0811 07:21:10.457601 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:10.457603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:10.457707 (+ 104us) server_negotiation.cc:407] Connection header received
0811 07:21:10.457751 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:10.457751 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:10.457762 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:10.457816 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:10.458514 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:10.459457 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:10.460450 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:10.460796 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:10.460877 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:10.462199 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:10.462201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:10.462201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:10.462209 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:10.463848 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:10.464223 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:10.464224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:10.464225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:10.464287 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:10.464489 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:10.464490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:10.464490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:10.464620 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:10.464719 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:10.464820 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 07:21:10.464897 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 07:21:10.486042 15169 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:10.486600 15169 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:10.496064 15169 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b7b2b13ae9c4c74aa1308142572a139: Generated new TSK 0
I20260811 07:21:10.496274 15169 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:21:10.504051 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15031
2026-08-11T07:21:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1645 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:10 dist-test-slave-7f01 krb5kdc[15200](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:10 dist-test-slave-7f01 krb5kdc[15200](info): set up 2 sockets
Aug 11 07:21:10 dist-test-slave-7f01 krb5kdc[15200](info): commencing operation
krb5kdc: starting...
W20260811 07:21:11.799425 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:11 dist-test-slave-7f01 krb5kdc[15200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:21:11.939005 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41129
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:40799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:41129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:12.027246 15220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:12.027473 15220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:12.027499 15220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:12.028785 15220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:12.028829 15220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:12.028851 15220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:12.028863 15220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:12.028925 15220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:12.030403 15220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:40799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:41129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:41129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:12.030669 15220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:12.030923 15220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:12.036022 15232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:12.036056 15233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:12.036056 15236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:12.036108 15220 server_base.cc:1034] running on GCE node
I20260811 07:21:12.036469 15220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:12.036892 15220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:12.038059 15220 hybrid_clock.cc:648] HybridClock initialized: now 1786432872038033 us; error 48 us; skew 500 ppm
Aug 11 07:21:12 dist-test-slave-7f01 krb5kdc[15200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432872, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:12.041844 15220 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:21:12.042354 15220 webserver.cc:460] Webserver started at http://127.9.142.190:33481/ using document root <none> and password file <none>
I20260811 07:21:12.042632 15220 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:12.042703 15220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:12.042847 15220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:12.044042 15220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "26f62b88aee54f718c32c406bef59bd3"
format_stamp: "Formatted at 2026-08-11 07:21:12 on dist-test-slave-7f01"
server_key: "fc8da26458ffd70ec605e1924ec58e07"
server_key_iv: "dc8c16df1438f99342e2bb38ae24be2b"
server_key_version: "encryptionkey@0"
I20260811 07:21:12.044433 15220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "26f62b88aee54f718c32c406bef59bd3"
format_stamp: "Formatted at 2026-08-11 07:21:12 on dist-test-slave-7f01"
server_key: "fc8da26458ffd70ec605e1924ec58e07"
server_key_iv: "dc8c16df1438f99342e2bb38ae24be2b"
server_key_version: "encryptionkey@0"
I20260811 07:21:12.045892 15220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:21:12.046706 15249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:12.046978 15220 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:12.047088 15220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "26f62b88aee54f718c32c406bef59bd3"
format_stamp: "Formatted at 2026-08-11 07:21:12 on dist-test-slave-7f01"
server_key: "fc8da26458ffd70ec605e1924ec58e07"
server_key_iv: "dc8c16df1438f99342e2bb38ae24be2b"
server_key_version: "encryptionkey@0"
I20260811 07:21:12.047176 15220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:12.063324 15220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:12.065661 15220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:12.065847 15220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:12.069978 15220 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:41129
I20260811 07:21:12.070014 15333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:41129 every 8 connection(s)
I20260811 07:21:12.070403 15220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:12.071345 15334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:12.073717 15334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3: Bootstrap starting.
I20260811 07:21:12.074350 15334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:12.074522 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15220
I20260811 07:21:12.074656 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:12.074685 15334 log.cc:824] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:12.074882 9786 external_mini_cluster.cc:1428] Setting key d6a7884e72d5fd24ec2fcbb864efa42d
I20260811 07:21:12.075668 15334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3: No bootstrap required, opened a new log
I20260811 07:21:12.078256 15334 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26f62b88aee54f718c32c406bef59bd3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41129 } }
I20260811 07:21:12.078438 15334 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:21:12.078473 15334 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26f62b88aee54f718c32c406bef59bd3, State: Initialized, Role: FOLLOWER
I20260811 07:21:12.078595 15334 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26f62b88aee54f718c32c406bef59bd3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41129 } }
I20260811 07:21:12.078701 15334 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:21:12.078759 15334 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:21:12.078810 15334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:12.079461 15334 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26f62b88aee54f718c32c406bef59bd3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41129 } }
I20260811 07:21:12.079589 15334 leader_election.cc:302] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26f62b88aee54f718c32c406bef59bd3; no voters:
I20260811 07:21:12.079802 15334 leader_election.cc:288] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:21:12.080014 15344 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:12.080085 15334 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:12.080199 15344 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [term 1 LEADER]: Becoming Leader. State: Replica: 26f62b88aee54f718c32c406bef59bd3, State: Running, Role: LEADER
I20260811 07:21:12.080298 15344 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26f62b88aee54f718c32c406bef59bd3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41129 } }
I20260811 07:21:12.080965 15346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26f62b88aee54f718c32c406bef59bd3. Latest consensus state: current_term: 1 leader_uuid: "26f62b88aee54f718c32c406bef59bd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26f62b88aee54f718c32c406bef59bd3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41129 } } }
I20260811 07:21:12.081063 15346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:12.081264 15359 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:12.081352 15342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:12.075456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42999 (local address 127.9.142.190:41129)
0811 07:21:12.075630 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:12.075639 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:12.075674 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:21:12.076160 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:12.076166 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:12.076212 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:12.076322 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:12.076607 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:12.077485 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:12.078636 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:12.079152 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:12.079230 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:12.080150 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:12.080154 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:12.080155 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:12.080374 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:12.080414 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:12.080428 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:12.080495 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:12.080779 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 07:21:12.080853 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
I20260811 07:21:12.081674 15345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26f62b88aee54f718c32c406bef59bd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26f62b88aee54f718c32c406bef59bd3" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 41129 } } }
I20260811 07:21:12.081753 15345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:12.082190 15359 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:12.082332 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:12.084005 15359 catalog_manager.cc:1347] Generated new cluster ID: dc4ec8f054cd4682ae9d2aa31bcb0654
I20260811 07:21:12.084081 15359 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:12.091559 15342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:12.083948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45843 (local address 127.9.142.190:41129)
0811 07:21:12.083988 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:12.083989 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:12.088091 (+ 4102us) server_negotiation.cc:407] Connection header received
0811 07:21:12.088199 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:12.088200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:12.088211 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:12.088271 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:12.088433 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:12.089153 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:12.090190 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:12.090485 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:12.090546 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:12.091283 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:12.091284 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:12.091285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:12.091289 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:12.091305 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:12.091309 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:12.091372 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:12.091440 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 07:21:12.091462 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:21:12.092773 15359 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:12.093354 15359 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:12.096596 15359 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26f62b88aee54f718c32c406bef59bd3: Generated new TSK 0
I20260811 07:21:12.096776 15359 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:21:12.099424 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15220
2026-08-11T07:21:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1598 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:12 dist-test-slave-7f01 krb5kdc[15389](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:12 dist-test-slave-7f01 krb5kdc[15389](info): set up 2 sockets
Aug 11 07:21:12 dist-test-slave-7f01 krb5kdc[15389](info): commencing operation
krb5kdc: starting...
W20260811 07:21:13.406036 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:13 dist-test-slave-7f01 krb5kdc[15389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:21:13.535696 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35129
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:40453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:35129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:13.618988 15404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:13.619232 15404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:13.619271 15404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:13.620433 15404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:13.620504 15404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:13.620529 15404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:13.620559 15404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:13.620589 15404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:13.622027 15404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:40453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:35129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:35129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:13.622303 15404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:13.622529 15404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:13.627503 15416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:13.627489 15414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:13.627518 15412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:13.627681 15404 server_base.cc:1034] running on GCE node
I20260811 07:21:13.628016 15404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:13.628312 15404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:13.629484 15404 hybrid_clock.cc:648] HybridClock initialized: now 1786432873629480 us; error 39 us; skew 500 ppm
Aug 11 07:21:13 dist-test-slave-7f01 krb5kdc[15389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432873, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:13.632006 15404 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:21:13.632476 15404 webserver.cc:460] Webserver started at http://127.9.142.190:36785/ using document root <none> and password file <none>
I20260811 07:21:13.632707 15404 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:13.632776 15404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:13.632929 15404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:13.633998 15404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "944286a2a37b44e2976f078b0c4a0e13"
format_stamp: "Formatted at 2026-08-11 07:21:13 on dist-test-slave-7f01"
server_key: "373c332d00d406702e1cc3226f1a6d08"
server_key_iv: "dce906484d98b21d43ce55e4bc030282"
server_key_version: "encryptionkey@0"
I20260811 07:21:13.634372 15404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "944286a2a37b44e2976f078b0c4a0e13"
format_stamp: "Formatted at 2026-08-11 07:21:13 on dist-test-slave-7f01"
server_key: "373c332d00d406702e1cc3226f1a6d08"
server_key_iv: "dce906484d98b21d43ce55e4bc030282"
server_key_version: "encryptionkey@0"
I20260811 07:21:13.635795 15404 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:21:13.636646 15426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:13.636864 15404 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:21:13.636976 15404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "944286a2a37b44e2976f078b0c4a0e13"
format_stamp: "Formatted at 2026-08-11 07:21:13 on dist-test-slave-7f01"
server_key: "373c332d00d406702e1cc3226f1a6d08"
server_key_iv: "dce906484d98b21d43ce55e4bc030282"
server_key_version: "encryptionkey@0"
I20260811 07:21:13.637059 15404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:13.640494 15404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:13.642831 15404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:13.643014 15404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:13.647537 15404 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:35129
I20260811 07:21:13.647619 15519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:35129 every 8 connection(s)
I20260811 07:21:13.647980 15404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:13.649081 15521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:13.650833 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15404
I20260811 07:21:13.650956 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:13.651153 9786 external_mini_cluster.cc:1428] Setting key 1d1619072afe2c5a0436e90845304722
I20260811 07:21:13.651873 15521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13: Bootstrap starting.
I20260811 07:21:13.652693 15521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:13.653066 15521 log.cc:824] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:13.653813 15521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13: No bootstrap required, opened a new log
I20260811 07:21:13.654332 15527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:13.651783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49691 (local address 127.9.142.190:35129)
0811 07:21:13.652004 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:13.652021 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:13.652048 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:21:13.652881 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:13.652889 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:13.652917 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:13.653043 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:13.653803 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:13.653807 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:13.653807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:13.653812 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:13.653877 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:13.653888 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:13.653994 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:13.654077 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 07:21:13.654130 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":76,"threads_started":1}
I20260811 07:21:13.655416 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:13.656576 15521 raft_consensus.cc:348] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944286a2a37b44e2976f078b0c4a0e13" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35129 } }
I20260811 07:21:13.656777 15521 raft_consensus.cc:374] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:21:13.656838 15521 raft_consensus.cc:729] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 944286a2a37b44e2976f078b0c4a0e13, State: Initialized, Role: FOLLOWER
I20260811 07:21:13.656973 15521 consensus_queue.cc:260] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944286a2a37b44e2976f078b0c4a0e13" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35129 } }
I20260811 07:21:13.657083 15521 raft_consensus.cc:388] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:21:13.657109 15521 raft_consensus.cc:482] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:21:13.657140 15521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:13.657747 15521 raft_consensus.cc:504] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944286a2a37b44e2976f078b0c4a0e13" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35129 } }
I20260811 07:21:13.657874 15521 leader_election.cc:302] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 944286a2a37b44e2976f078b0c4a0e13; no voters:
I20260811 07:21:13.658046 15521 leader_election.cc:288] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:21:13.658082 15542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:13.658236 15542 raft_consensus.cc:686] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [term 1 LEADER]: Becoming Leader. State: Replica: 944286a2a37b44e2976f078b0c4a0e13, State: Running, Role: LEADER
I20260811 07:21:13.658340 15521 sys_catalog.cc:564] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:13.658347 15542 consensus_queue.cc:237] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944286a2a37b44e2976f078b0c4a0e13" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35129 } }
I20260811 07:21:13.658766 15547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "944286a2a37b44e2976f078b0c4a0e13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944286a2a37b44e2976f078b0c4a0e13" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35129 } } }
I20260811 07:21:13.658946 15547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:13.659097 15527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:13.657584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42759 (local address 127.9.142.190:35129)
0811 07:21:13.657629 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:13.657631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:13.657875 (+ 244us) server_negotiation.cc:407] Connection header received
0811 07:21:13.657901 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:13.657902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:13.657906 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:13.657973 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:13.658763 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:13.658764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:13.658764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:21:13.658769 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:13.658784 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:21:13.658789 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:13.658835 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:13.658980 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 07:21:13.658995 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:21:13.659677 15558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:13.659938 15550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 944286a2a37b44e2976f078b0c4a0e13. Latest consensus state: current_term: 1 leader_uuid: "944286a2a37b44e2976f078b0c4a0e13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "944286a2a37b44e2976f078b0c4a0e13" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 35129 } } }
I20260811 07:21:13.660079 15550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:13.660338 15558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:13.661882 15558 catalog_manager.cc:1347] Generated new cluster ID: a6bc903557d44bd3b3e8e392aa34ed13
I20260811 07:21:13.661947 15558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:13.671554 15558 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:13.671782 15558 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:13.674871 15558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 944286a2a37b44e2976f078b0c4a0e13: Generated new TSK 0
I20260811 07:21:13.675071 15558 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:21:13.680895 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15404
2026-08-11T07:21:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1580 ms)
[----------] 18 tests from AuthTokenIssuingTest (28869 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:13 dist-test-slave-7f01 krb5kdc[15582](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:13 dist-test-slave-7f01 krb5kdc[15582](info): set up 2 sockets
Aug 11 07:21:13 dist-test-slave-7f01 krb5kdc[15582](info): commencing operation
krb5kdc: starting...
W20260811 07:21:15.045819 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.337s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:21:15.174431 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:43883
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:43883,127.9.142.189:37367,127.9.142.188:36169
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:15.263141 15606 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:21:15.263360 15606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:15.263376 15606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:15.263396 15606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:15.264598 15606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:15.264642 15606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:15.264657 15606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:15.264669 15606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:15.264681 15606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:15.266201 15606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:43883,127.9.142.189:37367,127.9.142.188:36169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:43883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:15.266467 15606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:15.266708 15606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:15.271914 15616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:15.271993 15606 server_base.cc:1034] running on GCE node
W20260811 07:21:15.271929 15622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:15.271929 15619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:15.272493 15606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:15.272809 15606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:15.273985 15606 hybrid_clock.cc:648] HybridClock initialized: now 1786432875273978 us; error 38 us; skew 500 ppm
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:15.276556 15606 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:21:15.277067 15606 webserver.cc:460] Webserver started at http://127.9.142.190:33121/ using document root <none> and password file <none>
I20260811 07:21:15.277326 15606 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:15.277397 15606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:15.277555 15606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:15.278635 15606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc"
format_stamp: "Formatted at 2026-08-11 07:21:15 on dist-test-slave-7f01"
server_key: "e1d3a172778e0c533efdfbb745fe8087"
server_key_iv: "9e98e5c236bddfb479c5bac1b8497625"
server_key_version: "encryptionkey@0"
I20260811 07:21:15.279016 15606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc"
format_stamp: "Formatted at 2026-08-11 07:21:15 on dist-test-slave-7f01"
server_key: "e1d3a172778e0c533efdfbb745fe8087"
server_key_iv: "9e98e5c236bddfb479c5bac1b8497625"
server_key_version: "encryptionkey@0"
I20260811 07:21:15.280565 15606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 07:21:15.281514 15632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:15.281764 15606 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:15.281890 15606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc"
format_stamp: "Formatted at 2026-08-11 07:21:15 on dist-test-slave-7f01"
server_key: "e1d3a172778e0c533efdfbb745fe8087"
server_key_iv: "9e98e5c236bddfb479c5bac1b8497625"
server_key_version: "encryptionkey@0"
I20260811 07:21:15.281973 15606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:15.295585 15606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:15.298300 15606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:15.298486 15606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:15.303210 15606 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:43883
I20260811 07:21:15.303246 15721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:43883 every 8 connection(s)
I20260811 07:21:15.303663 15606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:15.304811 15722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:15.306488 15722 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:15.311094 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15606
I20260811 07:21:15.311213 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:15.311474 9786 external_mini_cluster.cc:1428] Setting key cbf98b585da4267914d7d19d6fd4aaad
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:21:15.318444 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.307271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42948 (local address 127.9.142.190:43883)
0811 07:21:15.307462 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.307472 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.307562 (+ 90us) server_negotiation.cc:407] Connection header received
0811 07:21:15.308172 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.308174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.308192 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.308292 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.308814 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.309726 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.310614 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.310999 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.311092 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.313836 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.313845 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.313845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.313853 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.316660 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.317174 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.317177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.317177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.317267 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.317552 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.317553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.317553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.317773 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.317841 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.318108 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.318212 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":122,"threads_started":1}
I20260811 07:21:15.318531 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.307237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:43883 (local address 127.0.0.1:42948)
0811 07:21:15.307416 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.307459 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:15.308019 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:15.308295 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:15.308297 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:15.308555 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:15.308714 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.308718 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.309816 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.309817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.310522 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.310525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.311133 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.311135 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.311248 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.311946 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:15.311957 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:15.313738 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:15.316750 (+ 3012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.316758 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.316760 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.317063 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.317350 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.317351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.317351 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.317476 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.317855 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:15.317863 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:15.317950 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 07:21:15.318068 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 07:21:15.318324 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":73,"thread_start_us":100,"threads_started":1}
I20260811 07:21:15.319379 15722 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:15.319798 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.319638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:37367 (local address 127.0.0.1:35910)
0811 07:21:15.319692 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.319764 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 07:21:15.319981 15636 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
I20260811 07:21:15.320528 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.320384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:37367 (local address 127.0.0.1:35920)
0811 07:21:15.320461 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.320495 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 07:21:15.320693 15722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.189:37367: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.9.142.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab.
Entry for principal kudu/127.9.142.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab.
I20260811 07:21:15.343834 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.189:37367
--webserver_interface=127.9.142.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab
--principal=kudu/127.9.142.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:43883,127.9.142.189:37367,127.9.142.188:36169
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:21:15.369997 15722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } attempt: 1
I20260811 07:21:15.370572 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.370424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:37367 (local address 127.0.0.1:35930)
0811 07:21:15.370498 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.370540 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 07:21:15.370929 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.370832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:37367 (local address 127.0.0.1:35944)
0811 07:21:15.370879 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.370903 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 07:21:15.371018 15722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.189:37367: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
W20260811 07:21:15.438704 15733 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:21:15.439013 15733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:15.439049 15733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:15.439095 15733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 07:21:15.439193 15722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } attempt: 2
I20260811 07:21:15.439713 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.439544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:37367 (local address 127.0.0.1:35948)
0811 07:21:15.439622 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.439674 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 07:21:15.440227 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.440093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:37367 (local address 127.0.0.1:35950)
0811 07:21:15.440169 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.440204 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 07:21:15.440375 15722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.189:37367: Network error: Client connection negotiation failed: client connection to 127.9.142.189:37367: connect: Connection refused (error 111)
W20260811 07:21:15.440790 15733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:15.440843 15733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:15.440858 15733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:15.440871 15733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:15.440883 15733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:15.442507 15733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:43883,127.9.142.189:37367,127.9.142.188:36169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab
--principal=kudu/127.9.142.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.189:37367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.142.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:15.442793 15733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:15.443059 15733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:15.448137 15746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:15.448191 15742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:15.448189 15733 server_base.cc:1034] running on GCE node
W20260811 07:21:15.448159 15741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:15.448642 15733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:15.448980 15733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:15.450184 15733 hybrid_clock.cc:648] HybridClock initialized: now 1786432875450165 us; error 42 us; skew 500 ppm
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:15.457755 15733 init.cc:377] Logged in from keytab as kudu/127.9.142.189@KRBTEST.COM (short username kudu)
I20260811 07:21:15.458395 15733 webserver.cc:460] Webserver started at http://127.9.142.189:40087/ using document root <none> and password file <none>
I20260811 07:21:15.458685 15733 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:15.458763 15733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:15.458931 15733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:15.460175 15733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/data/instance:
uuid: "339b0e909b0a4867b3c44087c18a24e6"
format_stamp: "Formatted at 2026-08-11 07:21:15 on dist-test-slave-7f01"
server_key: "cbce93b113b468031223410b79c01d06"
server_key_iv: "46687e9b1077e69606cf0c562c6813e0"
server_key_version: "encryptionkey@0"
I20260811 07:21:15.460574 15733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/wal/instance:
uuid: "339b0e909b0a4867b3c44087c18a24e6"
format_stamp: "Formatted at 2026-08-11 07:21:15 on dist-test-slave-7f01"
server_key: "cbce93b113b468031223410b79c01d06"
server_key_iv: "46687e9b1077e69606cf0c562c6813e0"
server_key_version: "encryptionkey@0"
I20260811 07:21:15.462128 15733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:21:15.463697 15757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:15.464038 15733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:15.464149 15733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/wal
uuid: "339b0e909b0a4867b3c44087c18a24e6"
format_stamp: "Formatted at 2026-08-11 07:21:15 on dist-test-slave-7f01"
server_key: "cbce93b113b468031223410b79c01d06"
server_key_iv: "46687e9b1077e69606cf0c562c6813e0"
server_key_version: "encryptionkey@0"
I20260811 07:21:15.464214 15733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:15.493708 15733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:15.496258 15733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:15.496392 15733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:15.501793 15733 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.189:37367
I20260811 07:21:15.501982 15842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.189:37367 every 8 connection(s)
I20260811 07:21:15.502310 15733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
I20260811 07:21:15.503345 15844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:15.505072 15844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:15.511169 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15733
I20260811 07:21:15.511299 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-1/wal/instance
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:21:15.511511 9786 external_mini_cluster.cc:1428] Setting key e1e4b99b399e422938096b2153ea372c
I20260811 07:21:15.515558 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.505879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42950 (local address 127.9.142.190:43883)
0811 07:21:15.505954 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.505957 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.506208 (+ 251us) server_negotiation.cc:407] Connection header received
0811 07:21:15.506757 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.506759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.506781 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.506838 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.507559 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.508101 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.509163 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.509410 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.509476 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.512156 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.512158 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.512158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.512165 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.513937 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.514418 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.514420 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.514420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.514496 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.514763 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.514764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.514765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.514921 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.514990 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.515319 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.515416 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 07:21:15.515585 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.505830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:43883 (local address 127.0.0.1:42950)
0811 07:21:15.506073 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.506116 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:15.506652 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:15.506933 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:15.506937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:15.507244 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:15.507475 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.507480 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.508218 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.508219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.509063 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.509065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.509522 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.509523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.509629 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.510225 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:15.510233 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:15.512053 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:15.514038 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.514045 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.514048 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.514335 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.514575 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.514576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.514576 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.514691 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.515019 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:15.515026 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:15.515167 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 07:21:15.515266 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 07:21:15.515404 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":117,"threads_started":1}
I20260811 07:21:15.516268 15844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.9.142.188@KRBTEST.COM; defaulting to no policy
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.188@KRBTEST.COM" created.
I20260811 07:21:15.524473 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.516590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:37367 (local address 127.0.0.1:35952)
0811 07:21:15.516668 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.516679 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:15.516713 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:15.517000 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:15.517001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:15.517156 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:15.517205 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.517206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.518120 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.518122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.518671 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.518672 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.519207 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.519208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.519292 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.519733 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:15.519777 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:15.521047 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:15.523205 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.523206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.523207 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.523500 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.523720 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.523721 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.523721 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.523864 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.524219 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:15.524220 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:15.524262 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 07:21:15.524321 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 07:21:15.524402 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 07:21:15.524744 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.516664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35952 (local address 127.9.142.189:37367)
0811 07:21:15.516855 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.516859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.516877 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:21:15.516895 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.516897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.516909 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.517001 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.517301 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.518025 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.518776 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.519111 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.519210 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.521142 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.521151 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.521151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.521158 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.523095 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.523584 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.523586 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.523587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.523644 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.523937 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.523938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.523938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.524144 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.524234 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.524380 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.524485 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":99,"threads_started":1}
I20260811 07:21:15.525457 15844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:15.525861 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.525702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46066)
0811 07:21:15.525758 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.525826 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 07:21:15.526028 15759 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
I20260811 07:21:15.526501 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.526384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46082)
0811 07:21:15.526435 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.526470 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 07:21:15.526626 15844 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:36169: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
I20260811 07:21:15.531571 15722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } attempt: 3
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
I20260811 07:21:15.538892 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.531981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35964 (local address 127.9.142.189:37367)
0811 07:21:15.532042 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.532044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.532058 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:21:15.532083 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.532084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.532095 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.532144 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.532456 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.532978 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.533740 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.534013 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.534081 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.535996 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.535998 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.535998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.536006 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.537623 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.538072 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.538073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.538074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.538136 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.538359 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.538360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.538360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.538497 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.538563 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.538702 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.538768 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:21:15.538890 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.531908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:37367 (local address 127.0.0.1:35964)
0811 07:21:15.531960 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.531969 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:15.532033 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:15.532148 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:15.532148 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:15.532304 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:15.532365 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.532367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.533081 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.533082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.533667 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.533669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.534117 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.534118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.534215 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.534637 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:15.534641 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:15.535911 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:15.537750 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.537751 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.537751 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.537984 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.538204 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.538205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.538206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.538268 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.538567 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:15.538568 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:15.538609 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 07:21:15.538665 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:21:15.538740 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 07:21:15.539377 15722 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:15.539718 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.539615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46096)
0811 07:21:15.539661 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.539687 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab.
Entry for principal kudu/127.9.142.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab.
I20260811 07:21:15.540060 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.539986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46110)
0811 07:21:15.540019 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.540040 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 07:21:15.540143 15722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:36169: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
I20260811 07:21:15.540637 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.188:36169
--webserver_interface=127.9.142.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab
--principal=kudu/127.9.142.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:33025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:43883,127.9.142.189:37367,127.9.142.188:36169
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:21:15.571280 15722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } attempt: 1
I20260811 07:21:15.571843 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.571659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46120)
0811 07:21:15.571722 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.571813 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 07:21:15.572223 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.572125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46136)
0811 07:21:15.572169 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.572195 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 07:21:15.572312 15722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:36169: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
I20260811 07:21:15.575832 15844 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } attempt: 1
I20260811 07:21:15.576265 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.576134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46152)
0811 07:21:15.576198 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.576236 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 07:21:15.576640 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.576548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46156)
0811 07:21:15.576594 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.576621 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 07:21:15.576735 15844 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:36169: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
W20260811 07:21:15.626506 15857 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:21:15.626727 15857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:15.626745 15857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:15.626786 15857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:15.627981 15857 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:15.628023 15857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:15.628038 15857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:15.628050 15857 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:15.628100 15857 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:15.629590 15857 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:33025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:43883,127.9.142.189:37367,127.9.142.188:36169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab
--principal=kudu/127.9.142.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.188:36169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.142.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:15.629869 15857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:15.630121 15857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:15.635119 15867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:15.635147 15866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:15.635147 15870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:15.635520 15857 server_base.cc:1034] running on GCE node
I20260811 07:21:15.635883 15857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:15.636238 15857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:15.637409 15857 hybrid_clock.cc:648] HybridClock initialized: now 1786432875637406 us; error 38 us; skew 500 ppm
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:15.640084 15857 init.cc:377] Logged in from keytab as kudu/127.9.142.188@KRBTEST.COM (short username kudu)
I20260811 07:21:15.640540 15857 webserver.cc:460] Webserver started at http://127.9.142.188:38979/ using document root <none> and password file <none>
I20260811 07:21:15.640775 15857 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:15.640865 15857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:15.641026 15857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:15.642551 15857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/data/instance:
uuid: "a03a89472b4e4f14b1b16b35187fce5c"
format_stamp: "Formatted at 2026-08-11 07:21:15 on dist-test-slave-7f01"
server_key: "8b57366f0d9a8e8ce3f2b86eb641de21"
server_key_iv: "2b0a57b19d696b532a241f0ec05a9fd5"
server_key_version: "encryptionkey@0"
I20260811 07:21:15.643115 15857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/wal/instance:
uuid: "a03a89472b4e4f14b1b16b35187fce5c"
format_stamp: "Formatted at 2026-08-11 07:21:15 on dist-test-slave-7f01"
server_key: "8b57366f0d9a8e8ce3f2b86eb641de21"
server_key_iv: "2b0a57b19d696b532a241f0ec05a9fd5"
server_key_version: "encryptionkey@0"
I20260811 07:21:15.644834 15844 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } attempt: 2
I20260811 07:21:15.645165 15857 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 07:21:15.645263 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.645139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46162)
0811 07:21:15.645181 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.645228 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 07:21:15.645792 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.645646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46164)
0811 07:21:15.645712 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.645741 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 07:21:15.646013 15844 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:36169: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
I20260811 07:21:15.646155 15887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:15.646327 15857 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:21:15.646479 15857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/wal
uuid: "a03a89472b4e4f14b1b16b35187fce5c"
format_stamp: "Formatted at 2026-08-11 07:21:15 on dist-test-slave-7f01"
server_key: "8b57366f0d9a8e8ce3f2b86eb641de21"
server_key_iv: "2b0a57b19d696b532a241f0ec05a9fd5"
server_key_version: "encryptionkey@0"
I20260811 07:21:15.646605 15857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:15.647437 15722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } attempt: 2
I20260811 07:21:15.647864 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.647711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46178)
0811 07:21:15.647795 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.647840 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 07:21:15.648278 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.648189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46186)
0811 07:21:15.648231 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.648254 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 07:21:15.648365 15722 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:36169: Network error: Client connection negotiation failed: client connection to 127.9.142.188:36169: connect: Connection refused (error 111)
I20260811 07:21:15.670692 15857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:15.673879 15857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:15.674060 15857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:15.682960 15857 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.188:36169
I20260811 07:21:15.683003 15979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.188:36169 every 8 connection(s)
I20260811 07:21:15.683532 15857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
I20260811 07:21:15.684928 15980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:15.687387 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 15857
I20260811 07:21:15.687510 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786432592145333-9786-0/minicluster-data/master-2/wal/instance
I20260811 07:21:15.687723 9786 external_mini_cluster.cc:1428] Setting key a17d1c4527b0a4a6c9d892449c6bf40b
I20260811 07:21:15.687515 15980 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:21:15.701342 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.688452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42956 (local address 127.9.142.190:43883)
0811 07:21:15.688522 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.688524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.688829 (+ 305us) server_negotiation.cc:407] Connection header received
0811 07:21:15.689450 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.689451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.689462 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.689504 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.690353 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.691127 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.692483 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.692783 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.692826 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.697705 (+ 4879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.697708 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.697708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.697718 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.699587 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.700170 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.700171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.700171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.700237 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.700548 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.700549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.700550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.700710 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.700762 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.701153 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.701245 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 07:21:15.701612 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.688467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:43883 (local address 127.0.0.1:42956)
0811 07:21:15.688687 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.688739 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:15.689317 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:15.689596 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:15.689598 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:15.689988 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:15.690236 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.690242 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.691235 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.691236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.692376 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.692379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.692937 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.692939 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.693055 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.695248 (+ 2193us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:15.695257 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:15.697599 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:15.699689 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.699695 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.699697 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.700071 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.700313 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.700314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.700314 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.700448 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.700801 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:15.700808 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:15.700996 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 07:21:15.701104 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:21:15.701270 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":106,"threads_started":1}
I20260811 07:21:15.702206 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.688772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46194 (local address 127.9.142.188:36169)
0811 07:21:15.688920 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.688925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.688967 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:21:15.689326 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.689335 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.689363 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.689462 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.690352 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.691569 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.692622 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.693080 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.693142 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.698183 (+ 5041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.698191 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.698192 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.698198 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.700318 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.700718 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.700722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.700722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.700805 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.701036 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.701037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.701038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.701270 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.701465 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.702000 (+ 535us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.702083 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260811 07:21:15.702272 15980 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:21:15.711447 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.702602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:37367 (local address 127.0.0.1:35980)
0811 07:21:15.702820 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.702831 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:15.702865 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:15.703020 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:15.703021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:15.703172 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:15.703217 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.703219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.704246 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.704247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.705053 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.705056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.705636 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.705638 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.705702 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.706128 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:15.706133 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:15.707684 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:15.710300 (+ 2616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.710301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.710301 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.710542 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.710754 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.710755 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.710755 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.710810 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.711122 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:15.711123 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:15.711170 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 07:21:15.711252 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:21:15.711350 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202}
I20260811 07:21:15.711462 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.702780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35980 (local address 127.9.142.189:37367)
0811 07:21:15.702883 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.702885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.702898 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:21:15.702927 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.702928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.702940 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.703016 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.703314 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.704154 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.705147 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.705546 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.705628 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.708411 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.708413 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.708414 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.708422 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.710208 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.710619 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.710620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.710620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.710682 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.710913 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.710915 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.710915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.711042 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.711122 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.711294 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.711378 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:21:15.711637 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.703265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42966 (local address 127.9.142.190:43883)
0811 07:21:15.703307 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.703309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.703316 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:21:15.703350 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.703351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.703361 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.703415 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.704046 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.704836 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.705670 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.705940 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.705974 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.708758 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.708759 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.708760 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.708767 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.710377 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.710819 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.710820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.710821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.710873 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.711100 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.711101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.711102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.711215 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.711402 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.711438 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.711510 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 07:21:15.711822 15980 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
I20260811 07:21:15.719033 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.712161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46206 (local address 127.9.142.188:36169)
0811 07:21:15.712201 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.712203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.712211 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:21:15.712230 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.712231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.712243 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.712313 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.712571 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.713199 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.713908 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.714159 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.714208 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.716305 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.716306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.716307 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.716313 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.717851 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.718273 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.718274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.718274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.718346 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.718568 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.718569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.718570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.718674 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.718730 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.718891 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.718973 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":13,"server-negotiator.queue_time_us":21}
I20260811 07:21:15.719148 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.712091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46206)
0811 07:21:15.712124 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.712134 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:15.712169 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:15.712331 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:15.712332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:15.712441 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:15.712470 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.712471 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.713280 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.713282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.713823 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.713831 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.714232 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.714233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.714289 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.714638 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:15.714643 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:15.716219 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:15.717947 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.717948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.717949 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.718200 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.718421 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.718422 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.718422 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.718498 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.718746 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:15.718747 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:15.718792 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 07:21:15.718874 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:21:15.719037 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":52}
I20260811 07:21:15.720417 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.712803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35988 (local address 127.9.142.189:37367)
0811 07:21:15.712838 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.712839 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.712847 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:21:15.712893 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.712894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.712902 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.712955 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.713447 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.713886 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.714718 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.714909 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.714961 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.717428 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.717429 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.717430 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.717437 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.719256 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.719680 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.719682 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.719682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.719770 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.719970 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.719970 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.719971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.720065 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.720167 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.720272 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.720336 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 07:21:15.721141 15980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c: Bootstrap starting.
I20260811 07:21:15.722007 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:15.722301 15980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:15.722602 15980 log.cc:824] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:15.723434 15980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c: No bootstrap required, opened a new log
I20260811 07:21:15.723227 15676 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42966
I20260811 07:21:15.725152 15980 raft_consensus.cc:348] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } }
I20260811 07:21:15.725304 15980 raft_consensus.cc:729] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03a89472b4e4f14b1b16b35187fce5c, State: Initialized, Role: FOLLOWER
I20260811 07:21:15.725404 15980 consensus_queue.cc:260] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } }
I20260811 07:21:15.725726 15980 sys_catalog.cc:564] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:15.725708 15988 sys_catalog.cc:455] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.725837 15988 sys_catalog.cc:458] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:21:15.727699 16005 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:21:15.727795 16005 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:21:15.727947 15857 master_runner.cc:186] Error getting master registration for 127.9.142.190:43883: OK, instance_id { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" instance_seqno: 1786432875301959 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:21:15.730794 15857 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:21:15.737154 15844 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } attempt: 3
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:21:15.745899 15847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.737453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46212)
0811 07:21:15.737509 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.737522 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:15.737571 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:15.737782 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:15.737784 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:15.738003 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:15.738057 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.738060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.738977 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.738978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.740486 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.740490 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.740970 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.740972 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.741029 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.741526 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:15.741532 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:15.742879 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:15.744724 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.744725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.744725 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.744949 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.745176 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.745177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.745178 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.745245 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.745577 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:15.745577 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:15.745623 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:21:15.745693 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 07:21:15.745788 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 07:21:15.745911 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.737563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46212 (local address 127.9.142.188:36169)
0811 07:21:15.737623 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.737625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.737633 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:21:15.737658 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.737659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.737669 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.737744 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.738137 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.738893 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.740577 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.740884 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.740961 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.742968 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.742969 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.742969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.742977 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.744626 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.745032 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.745034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.745034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.745101 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.745312 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.745313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.745314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.745503 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.745576 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.745735 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.745818 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 07:21:15.747459 15722 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } attempt: 3
I20260811 07:21:15.747694 15844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6: Bootstrap starting.
I20260811 07:21:15.748548 15844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:15.748880 15844 log.cc:824] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:15.749769 15844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6: No bootstrap required, opened a new log
I20260811 07:21:15.751996 15844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } }
I20260811 07:21:15.752147 15844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 339b0e909b0a4867b3c44087c18a24e6, State: Initialized, Role: FOLLOWER
Aug 11 07:21:15 dist-test-slave-7f01 krb5kdc[15582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432875, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:21:15.752239 15844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } }
I20260811 07:21:15.752614 15844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:15.752629 16013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.753021 16013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:21:15.755018 16027 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:21:15.755162 16027 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:21:15.755577 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.747776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:36169 (local address 127.0.0.1:46228)
0811 07:21:15.747831 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:15.747841 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:15.747879 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:15.748079 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:15.748080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:15.748266 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:15.748317 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.748319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.749219 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.749221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.750057 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:15.750060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.750525 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.750526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:15.750593 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.751045 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:15.751050 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:15.752561 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:15.754536 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.754537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.754538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.754756 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.754959 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:15.754959 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:15.754960 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:15.755014 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:15.755278 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:15.755279 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:15.755321 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 07:21:15.755366 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 07:21:15.755460 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 07:21:15.755982 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.747822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.9.142.188:36169)
0811 07:21:15.747948 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.747950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.747957 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:21:15.747976 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.747977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.747985 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.748030 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.748403 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.749114 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.750158 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.750451 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.750520 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.752656 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.752657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.752657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.752664 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.754428 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.754837 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.754838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.754838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.754890 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.755084 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.755084 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.755085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.755204 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.755775 (+ 571us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.755821 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.755895 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260811 07:21:15.757438 15722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc: Bootstrap starting.
I20260811 07:21:15.754746 15733 master_runner.cc:186] Error getting master registration for 127.9.142.190:43883: OK, instance_id { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" instance_seqno: 1786432875301959 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:21:15.757714 15733 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:21:15.758296 15722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:15.758639 15722 log.cc:824] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:15.759491 15722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc: No bootstrap required, opened a new log
I20260811 07:21:15.760878 15722 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } }
I20260811 07:21:15.761021 15722 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04ca4506ae4a4a6ebba20d270e5f6fdc, State: Initialized, Role: FOLLOWER
I20260811 07:21:15.761104 15722 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } }
I20260811 07:21:15.761394 15722 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:15.761462 15676 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 07:21:15.761368 16035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.761518 16035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:15.761521 15676 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:15.762414 15676 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } }
I20260811 07:21:15.762709 15676 leader_election.cc:288] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [CANDIDATE]: Term 1 election: Requested vote from peers 339b0e909b0a4867b3c44087c18a24e6 (127.9.142.189:37367), a03a89472b4e4f14b1b16b35187fce5c (127.9.142.188:36169)
I20260811 07:21:15.762972 15801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "339b0e909b0a4867b3c44087c18a24e6"
I20260811 07:21:15.762979 15938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a03a89472b4e4f14b1b16b35187fce5c"
I20260811 07:21:15.763105 15801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:15.763109 15938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:15.763916 15801 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04ca4506ae4a4a6ebba20d270e5f6fdc in term 1.
I20260811 07:21:15.764074 15938 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04ca4506ae4a4a6ebba20d270e5f6fdc in term 1.
I20260811 07:21:15.764156 15636 leader_election.cc:302] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04ca4506ae4a4a6ebba20d270e5f6fdc, 339b0e909b0a4867b3c44087c18a24e6; no voters:
I20260811 07:21:15.764281 16035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:15.764467 16035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [term 1 LEADER]: Becoming Leader. State: Replica: 04ca4506ae4a4a6ebba20d270e5f6fdc, State: Running, Role: LEADER
I20260811 07:21:15.764564 16035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } }
I20260811 07:21:15.765007 16035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ca4506ae4a4a6ebba20d270e5f6fdc. Latest consensus state: current_term: 1 leader_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.765102 16035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [sys.catalog]: This master's current role is: LEADER
W20260811 07:21:15.766510 16072 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:21:15.768054 16072 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:21:15.768288 16069 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:15.768510 16069 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:15.773823 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.765567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42982 (local address 127.9.142.190:43883)
0811 07:21:15.765641 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.765643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.766117 (+ 474us) server_negotiation.cc:407] Connection header received
0811 07:21:15.766215 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.766216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.766226 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.766255 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.767146 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.767882 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.768941 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.769229 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.769281 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.770891 (+ 1610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.770892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.770892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.770900 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.772579 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.772995 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.772997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.772997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.773056 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.773243 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.773244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.773244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.773359 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.773442 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.773647 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.773721 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:21:15.775023 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.765549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46238 (local address 127.9.142.188:36169)
0811 07:21:15.765610 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.765612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.767228 (+ 1616us) server_negotiation.cc:407] Connection header received
0811 07:21:15.767316 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.767317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.767328 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.767355 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.768194 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.768920 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.769949 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.770241 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.770279 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.772019 (+ 1740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.772020 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.772021 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.772027 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.773671 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.774163 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.774164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.774165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.774225 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.774451 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.774452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.774453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.774581 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.774648 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.774862 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.774940 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:21:15.776666 15938 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [term 1 FOLLOWER]: Refusing update from remote peer 04ca4506ae4a4a6ebba20d270e5f6fdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:21:15.776883 15801 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [term 1 FOLLOWER]: Refusing update from remote peer 04ca4506ae4a4a6ebba20d270e5f6fdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:21:15.777096 16035 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:21:15.777275 16035 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:21:15.778790 16013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ca4506ae4a4a6ebba20d270e5f6fdc. Latest consensus state: current_term: 1 leader_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.778895 16013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:15.779371 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:15.765785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35990 (local address 127.9.142.189:37367)
0811 07:21:15.765822 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.765824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.769360 (+ 3536us) server_negotiation.cc:407] Connection header received
0811 07:21:15.769505 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.769506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.769517 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.769549 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.771822 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.772580 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.773550 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:15.773826 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:15.773870 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:15.775605 (+ 1735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:15.775606 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:15.775607 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:15.775614 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:15.778040 (+ 2426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.778446 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.778448 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.778448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.778512 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:15.778734 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:15.778734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:15.778735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:15.778886 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:15.778974 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:15.779212 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 07:21:15.779293 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 07:21:15.780179 15988 sys_catalog.cc:455] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ca4506ae4a4a6ebba20d270e5f6fdc. Latest consensus state: current_term: 1 leader_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.780257 15988 sys_catalog.cc:458] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:15.782593 16079 mvcc.cc:205] Tried to move back new op lower bound from 7317229059178582016 to 7317229059132346368. Current Snapshot: MvccSnapshot[applied={T|T < 7317229059178582016}]
I20260811 07:21:15.782872 16035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.782959 16035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:15.783437 15988 sys_catalog.cc:455] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.783524 15988 sys_catalog.cc:458] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:15.783602 16087 mvcc.cc:205] Tried to move back new op lower bound from 7317229059178582016 to 7317229059132346368. Current Snapshot: MvccSnapshot[applied={T|T < 7317229059178582016}]
I20260811 07:21:15.788758 16035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.788858 16035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:15.789332 16013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04ca4506ae4a4a6ebba20d270e5f6fdc" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 43883 } } peers { permanent_uuid: "339b0e909b0a4867b3c44087c18a24e6" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 37367 } } peers { permanent_uuid: "a03a89472b4e4f14b1b16b35187fce5c" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 36169 } } }
I20260811 07:21:15.789413 16013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:15.790040 16069 catalog_manager.cc:1347] Generated new cluster ID: f693e94a9b444dc99a002009ecf42507
I20260811 07:21:15.790096 16069 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:15.832880 16069 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:15.834707 16069 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:15.838340 16069 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04ca4506ae4a4a6ebba20d270e5f6fdc: Generated new TSK 0
I20260811 07:21:15.838603 16069 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:21:15.870049 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.868398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36004 (local address 127.9.142.189:37367)
0811 07:21:15.868467 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.868469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.869300 (+ 831us) server_negotiation.cc:407] Connection header received
0811 07:21:15.869418 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.869420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.869431 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.869465 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.869971 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36004: BlockingRecv error: recv got EOF from 127.0.0.1:36004 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 07:21:15.870862 15984 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.869032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46242 (local address 127.9.142.188:36169)
0811 07:21:15.869082 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.869084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.870318 (+ 1234us) server_negotiation.cc:407] Connection header received
0811 07:21:15.870419 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.870420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.870431 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.870463 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.870797 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46242: BlockingRecv error: recv got EOF from 127.0.0.1:46242 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 07:21:15.871974 15728 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.871233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42988 (local address 127.9.142.190:43883)
0811 07:21:15.871277 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.871279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.871400 (+ 121us) server_negotiation.cc:407] Connection header received
0811 07:21:15.871497 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.871498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.871509 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.871539 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.871887 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42988: BlockingRecv error: recv got EOF from 127.0.0.1:42988 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 07:21:15.874586 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.873756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36010 (local address 127.9.142.189:37367)
0811 07:21:15.873795 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.873796 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.874025 (+ 229us) server_negotiation.cc:407] Connection header received
0811 07:21:15.874135 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.874136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.874154 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.874183 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.874539 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36010: BlockingRecv error: recv got EOF from 127.0.0.1:36010 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 07:21:15.877996 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.877076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36016 (local address 127.9.142.189:37367)
0811 07:21:15.877129 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.877131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.877470 (+ 339us) server_negotiation.cc:407] Connection header received
0811 07:21:15.877573 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.877574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.877587 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.877615 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.877938 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36016: BlockingRecv error: recv got EOF from 127.0.0.1:36016 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260811 07:21:15.885429 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.884496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36018 (local address 127.9.142.189:37367)
0811 07:21:15.884539 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.884541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.884817 (+ 276us) server_negotiation.cc:407] Connection header received
0811 07:21:15.884938 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.884939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.884953 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.884984 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.885371 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36018: BlockingRecv error: recv got EOF from 127.0.0.1:36018 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 07:21:15.891774 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.890780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36024 (local address 127.9.142.189:37367)
0811 07:21:15.890823 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.890825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.891127 (+ 302us) server_negotiation.cc:407] Connection header received
0811 07:21:15.891238 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.891239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.891251 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.891281 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.891689 (+ 408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36024: BlockingRecv error: recv got EOF from 127.0.0.1:36024 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 07:21:15.902029 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.901058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36034 (local address 127.9.142.189:37367)
0811 07:21:15.901105 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.901107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.901399 (+ 292us) server_negotiation.cc:407] Connection header received
0811 07:21:15.901511 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.901512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.901524 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.901554 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.901946 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36034: BlockingRecv error: recv got EOF from 127.0.0.1:36034 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 07:21:15.920423 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.919379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36048 (local address 127.9.142.189:37367)
0811 07:21:15.919426 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.919428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.919773 (+ 345us) server_negotiation.cc:407] Connection header received
0811 07:21:15.919891 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.919892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.919905 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.919935 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.920359 (+ 424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36048: BlockingRecv error: recv got EOF from 127.0.0.1:36048 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 07:21:15.954716 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:15.953880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36050 (local address 127.9.142.189:37367)
0811 07:21:15.953955 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:15.953958 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:15.954103 (+ 145us) server_negotiation.cc:407] Connection header received
0811 07:21:15.954172 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:15.954173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:15.954184 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:15.954238 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:15.954642 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36050: BlockingRecv error: recv got EOF from 127.0.0.1:36050 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 07:21:16.020849 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:16.020077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36056 (local address 127.9.142.189:37367)
0811 07:21:16.020148 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:16.020150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:16.020190 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:21:16.020279 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:16.020280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:16.020292 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:16.020334 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:16.020751 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36056: BlockingRecv error: recv got EOF from 127.0.0.1:36056 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 07:21:16.150811 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:16.149967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36070 (local address 127.9.142.189:37367)
0811 07:21:16.150055 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:16.150058 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:16.150161 (+ 103us) server_negotiation.cc:407] Connection header received
0811 07:21:16.150262 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:16.150263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:16.150282 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:16.150360 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:16.150740 (+ 380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36070: BlockingRecv error: recv got EOF from 127.0.0.1:36070 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 07:21:16.408871 15852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:16.408146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36082 (local address 127.9.142.189:37367)
0811 07:21:16.408231 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:16.408233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:16.408259 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:21:16.408336 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:16.408337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:16.408347 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:16.408411 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:16.408810 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36082: BlockingRecv error: recv got EOF from 127.0.0.1:36082 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:21:16.728411 16005 catalog_manager.cc:1259] Loaded cluster ID: f693e94a9b444dc99a002009ecf42507
I20260811 07:21:16.728506 16005 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c: loading cluster ID for follower catalog manager: success
I20260811 07:21:16.729388 16005 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c: acquiring CA information for follower catalog manager: success
I20260811 07:21:16.729671 16005 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a03a89472b4e4f14b1b16b35187fce5c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:21:16.755812 16027 catalog_manager.cc:1259] Loaded cluster ID: f693e94a9b444dc99a002009ecf42507
I20260811 07:21:16.755910 16027 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6: loading cluster ID for follower catalog manager: success
I20260811 07:21:16.756807 16027 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6: acquiring CA information for follower catalog manager: success
I20260811 07:21:16.757136 16027 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 339b0e909b0a4867b3c44087c18a24e6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:21:16.924882 16193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:16.922235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36086 (local address 127.9.142.189:37367)
0811 07:21:16.922348 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:16.922350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:16.922411 (+ 61us) server_negotiation.cc:407] Connection header received
0811 07:21:16.922475 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:16.922476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:16.922534 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:16.922612 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:16.922765 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.923276 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.924100 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.924295 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.924350 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:16.924539 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:16.924649 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:16.924708 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:16.924745 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 07:21:16.924763 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":54,"threads_started":1}
I20260811 07:21:16.929877 16201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:16.927223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46244 (local address 127.9.142.188:36169)
0811 07:21:16.927377 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:16.927379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:16.927389 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:21:16.927428 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:16.927428 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:16.927463 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:16.927538 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:16.927625 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.928234 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.928982 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.929281 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.929353 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:16.929514 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:16.929646 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:16.929719 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:16.929760 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 07:21:16.929785 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":78,"threads_started":1}
I20260811 07:21:16.934722 16193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:16.931843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36092 (local address 127.9.142.189:37367)
0811 07:21:16.931890 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:16.931892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:16.932121 (+ 229us) server_negotiation.cc:407] Connection header received
0811 07:21:16.932229 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:16.932231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:16.932243 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:16.932276 (+ 33us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:16.932510 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.933230 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.933954 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.934210 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.934266 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:16.934438 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:16.934471 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:16.934499 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:16.934614 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 07:21:16.934636 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 07:21:16.935076 16201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:16.931724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.9.142.188:36169)
0811 07:21:16.931781 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:16.931783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:16.932065 (+ 282us) server_negotiation.cc:407] Connection header received
0811 07:21:16.932168 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:16.932168 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:16.932178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:16.932249 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:16.932440 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.933170 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.934287 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.934554 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.934623 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:16.934749 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:16.934785 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:16.934833 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:16.934949 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 07:21:16.934978 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:21:16.935339 16213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:16.931675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42996 (local address 127.9.142.190:43883)
0811 07:21:16.931832 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:16.931834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:16.932027 (+ 193us) server_negotiation.cc:407] Connection header received
0811 07:21:16.932091 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:16.932092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:16.932148 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:16.932239 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:16.932364 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.932977 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.934154 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:16.934474 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:16.934544 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:16.934750 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:16.934877 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:16.935201 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:16.935223 (+ 22us) server_negotiation.cc:299] Negotiation successful
0811 07:21:16.935252 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
I20260811 07:21:16.937016 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15606
I20260811 07:21:16.951804 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15733
I20260811 07:21:16.965231 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 15857
2026-08-11T07:21:16Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3282 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:21:17 dist-test-slave-7f01 krb5kdc[16219](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:21:17 dist-test-slave-7f01 krb5kdc[16219](info): set up 2 sockets
Aug 11 07:21:17 dist-test-slave-7f01 krb5kdc[16219](info): commencing operation
krb5kdc: starting...
W20260811 07:21:18.256011 9786 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/test-user.keytab.
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:21:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:21:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.142.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
Entry for principal kudu/127.9.142.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab.
I20260811 07:21:18.384341 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:42533
--webserver_interface=127.9.142.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:42647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:42533,127.9.142.189:45777,127.9.142.188:43445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:21:18.467723 16239 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:21:18.468037 16239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:18.468070 16239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:18.468112 16239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:18.469244 16239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:18.469321 16239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:18.469347 16239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:18.469372 16239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:18.469396 16239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:18.470903 16239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:42647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:42533,127.9.142.189:45777,127.9.142.188:43445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.190.keytab
--principal=kudu/127.9.142.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.190:42533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.142.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:18.471211 16239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:18.471467 16239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:18.476265 16247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:18.476305 16246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:18.476317 16249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:18.476574 16239 server_base.cc:1034] running on GCE node
I20260811 07:21:18.476835 16239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:18.477144 16239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:18.478292 16239 hybrid_clock.cc:648] HybridClock initialized: now 1786432878478265 us; error 40 us; skew 500 ppm
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:18.481520 16239 init.cc:377] Logged in from keytab as kudu/127.9.142.190@KRBTEST.COM (short username kudu)
I20260811 07:21:18.481911 16239 webserver.cc:460] Webserver started at http://127.9.142.190:45031/ using document root <none> and password file <none>
I20260811 07:21:18.482177 16239 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:18.482250 16239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:18.482599 16239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:18.483709 16239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/data/instance:
uuid: "54df265b68cd46ac900977b973c31433"
format_stamp: "Formatted at 2026-08-11 07:21:18 on dist-test-slave-7f01"
server_key: "90435b36b98668ea0a1bbfe194213abb"
server_key_iv: "bd41eb55c6f558854656d05b4d779c59"
server_key_version: "encryptionkey@0"
I20260811 07:21:18.484153 16239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/wal/instance:
uuid: "54df265b68cd46ac900977b973c31433"
format_stamp: "Formatted at 2026-08-11 07:21:18 on dist-test-slave-7f01"
server_key: "90435b36b98668ea0a1bbfe194213abb"
server_key_iv: "bd41eb55c6f558854656d05b4d779c59"
server_key_version: "encryptionkey@0"
I20260811 07:21:18.485566 16239 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:18.486435 16262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:18.486653 16239 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:18.486799 16239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/wal
uuid: "54df265b68cd46ac900977b973c31433"
format_stamp: "Formatted at 2026-08-11 07:21:18 on dist-test-slave-7f01"
server_key: "90435b36b98668ea0a1bbfe194213abb"
server_key_iv: "bd41eb55c6f558854656d05b4d779c59"
server_key_version: "encryptionkey@0"
I20260811 07:21:18.486887 16239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:18.496333 16239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:18.498621 16239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:18.498915 16239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:18.503842 16239 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.190:42533
I20260811 07:21:18.503898 16345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.190:42533 every 8 connection(s)
I20260811 07:21:18.504302 16239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/data/info.pb
I20260811 07:21:18.505211 16346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:18.506893 16346 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:18.509488 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 16239
I20260811 07:21:18.509624 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-0/wal/instance
I20260811 07:21:18.509835 9786 external_mini_cluster.cc:1428] Setting key ba69711c93ac42c0203195cbbe0b1091
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:21:18.517798 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.507627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42533 (local address 127.0.0.1:43400)
0811 07:21:18.507836 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.507881 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:18.508347 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:18.508662 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:18.508664 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:18.508920 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:18.509078 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.509082 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.510329 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.510331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.511451 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.511455 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.512157 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.512158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.512217 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.512838 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:18.512847 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:18.514233 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:18.516207 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.516215 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.516217 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.516422 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.516673 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.516674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.516674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.516765 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.517154 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:18.517160 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:18.517223 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 07:21:18.517347 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 07:21:18.517594 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":115,"thread_start_us":107,"threads_started":1}
I20260811 07:21:18.517814 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.507724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43400 (local address 127.9.142.190:42533)
0811 07:21:18.507937 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.507948 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.507979 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:21:18.508520 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.508523 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.508540 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.508631 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.509184 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.510220 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.511568 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.512035 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.512167 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.514361 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.514370 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.514371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.514382 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.516090 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.516518 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.516521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.516521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.516605 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.516853 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.516854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.516854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.517072 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.517164 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.517384 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.517545 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":180,"thread_start_us":146,"threads_started":1}
I20260811 07:21:18.518536 16346 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:18.519017 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.518858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:45777 (local address 127.0.0.1:46308)
0811 07:21:18.518936 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.518991 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 07:21:18.519197 16264 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.9.142.189@KRBTEST.COM; defaulting to no policy
I20260811 07:21:18.519642 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.519532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:45777 (local address 127.0.0.1:46314)
0811 07:21:18.519574 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.519611 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 07:21:18.519785 16346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.189:45777: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab.
Entry for principal kudu/127.9.142.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab.
I20260811 07:21:18.540313 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.189:45777
--webserver_interface=127.9.142.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab
--principal=kudu/127.9.142.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:42647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:42533,127.9.142.189:45777,127.9.142.188:43445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:21:18.569084 16346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } attempt: 1
I20260811 07:21:18.569722 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.569559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:45777 (local address 127.0.0.1:46328)
0811 07:21:18.569645 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.569690 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 07:21:18.570143 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.570051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:45777 (local address 127.0.0.1:46334)
0811 07:21:18.570097 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.570124 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 07:21:18.570271 16346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.189:45777: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
W20260811 07:21:18.631601 16370 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:21:18.631932 16370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:18.631978 16370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:18.632027 16370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:18.633313 16370 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:18.633392 16370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:18.633421 16370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:18.633453 16370 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:18.633486 16370 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:18.635196 16370 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:42647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:42533,127.9.142.189:45777,127.9.142.188:43445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.189.keytab
--principal=kudu/127.9.142.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.189:45777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.142.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:18.635525 16370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:18.635910 16370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:21:18.638504 16346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } attempt: 2
I20260811 07:21:18.639305 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.639001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:45777 (local address 127.0.0.1:46348)
0811 07:21:18.639189 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.639263 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260811 07:21:18.639851 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.639667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:45777 (local address 127.0.0.1:46358)
0811 07:21:18.639732 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.639812 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 07:21:18.639986 16346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.189:45777: Network error: Client connection negotiation failed: client connection to 127.9.142.189:45777: connect: Connection refused (error 111)
W20260811 07:21:18.641834 16379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:18.641968 16370 server_base.cc:1034] running on GCE node
W20260811 07:21:18.641886 16375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:18.641911 16383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:18.642323 16370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:18.642664 16370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:18.643841 16370 hybrid_clock.cc:648] HybridClock initialized: now 1786432878643813 us; error 51 us; skew 500 ppm
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:18.646723 16370 init.cc:377] Logged in from keytab as kudu/127.9.142.189@KRBTEST.COM (short username kudu)
I20260811 07:21:18.647292 16370 webserver.cc:460] Webserver started at http://127.9.142.189:44647/ using document root <none> and password file <none>
I20260811 07:21:18.647552 16370 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:18.647630 16370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:18.647831 16370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:18.649045 16370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/data/instance:
uuid: "5c2fd2cce21d4604a0ce67544221e744"
format_stamp: "Formatted at 2026-08-11 07:21:18 on dist-test-slave-7f01"
server_key: "747ceb8b39c98fec6efc0bd2b5f358a8"
server_key_iv: "4256c96428af3a01d186beab1456b616"
server_key_version: "encryptionkey@0"
I20260811 07:21:18.649462 16370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/wal/instance:
uuid: "5c2fd2cce21d4604a0ce67544221e744"
format_stamp: "Formatted at 2026-08-11 07:21:18 on dist-test-slave-7f01"
server_key: "747ceb8b39c98fec6efc0bd2b5f358a8"
server_key_iv: "4256c96428af3a01d186beab1456b616"
server_key_version: "encryptionkey@0"
I20260811 07:21:18.650981 16370 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:21:18.651911 16393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:18.652101 16370 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:18.652220 16370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/wal
uuid: "5c2fd2cce21d4604a0ce67544221e744"
format_stamp: "Formatted at 2026-08-11 07:21:18 on dist-test-slave-7f01"
server_key: "747ceb8b39c98fec6efc0bd2b5f358a8"
server_key_iv: "4256c96428af3a01d186beab1456b616"
server_key_version: "encryptionkey@0"
I20260811 07:21:18.652318 16370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:18.670418 16370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:18.673004 16370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:18.673169 16370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:18.678476 16370 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.189:45777
I20260811 07:21:18.678565 16482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.189:45777 every 8 connection(s)
I20260811 07:21:18.679080 16370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/data/info.pb
I20260811 07:21:18.680778 16483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:18.683254 16483 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:18.686976 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 16370
I20260811 07:21:18.687137 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-1/wal/instance
I20260811 07:21:18.687359 9786 external_mini_cluster.cc:1428] Setting key 5e56c1a113e3a5c644d621f89fd97282
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:21:18.695132 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.684312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43414 (local address 127.9.142.190:42533)
0811 07:21:18.684414 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.684417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.684586 (+ 169us) server_negotiation.cc:407] Connection header received
0811 07:21:18.685510 (+ 924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.685511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.685528 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.685594 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.686290 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.687009 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.688461 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.688706 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.688916 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.691683 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.691685 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.691686 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.691694 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.693445 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.693961 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.693963 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.693964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.694037 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.694325 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.694327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.694327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.694489 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.694573 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.694920 (+ 347us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.695024 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:21:18.695371 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.684237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42533 (local address 127.0.0.1:43414)
0811 07:21:18.684448 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.684489 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:18.685353 (+ 864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:18.685671 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:18.685675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:18.685969 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:18.686179 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.686183 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.687205 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.687207 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.688340 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.688344 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.688964 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.688966 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.689150 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.689809 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:18.689819 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:18.691558 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:18.693568 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.693578 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.693581 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.693849 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.694115 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.694116 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.694116 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.694246 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.694575 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:18.694584 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:18.694752 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 07:21:18.694894 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 07:21:18.695089 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":119,"threads_started":1}
I20260811 07:21:18.696087 16483 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.9.142.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.142.188@KRBTEST.COM" created.
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
I20260811 07:21:18.705578 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.696514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:45777 (local address 127.0.0.1:46370)
0811 07:21:18.696556 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.696566 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:18.696615 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:18.696881 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:18.696882 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:18.697038 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:18.697092 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.697094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.697975 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.697976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.698557 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.698558 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.699049 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.699051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.699116 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.699591 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:18.699596 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:18.702459 (+ 2863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:18.704431 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.704432 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.704433 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.704601 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.704845 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.704846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.704846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.704901 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.705200 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:18.705201 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:18.705240 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 07:21:18.705323 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:21:18.705426 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 07:21:18.705683 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.696564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46370 (local address 127.9.142.189:45777)
0811 07:21:18.696733 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.696737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.696754 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:21:18.696774 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.696776 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.696794 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.696880 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.697178 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.697880 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.698649 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.698972 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.699054 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.702571 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.702582 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.702582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.702590 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.704324 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.704698 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.704701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.704701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.704760 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.704972 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.704973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.704973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.705125 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.705222 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.705446 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.705536 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":113,"threads_started":1}
I20260811 07:21:18.706400 16483 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:18.706832 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.706677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:48930)
0811 07:21:18.706732 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.706799 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 07:21:18.706975 16394 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
I20260811 07:21:18.707473 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.707337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:48944)
0811 07:21:18.707418 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.707450 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 07:21:18.707623 16483 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43445: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.142.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab.
Entry for principal kudu/127.9.142.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab.
I20260811 07:21:18.720228 9786 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNunSB7/build/release/bin/kudu
/tmp/dist-test-taskNunSB7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.188:43445
--webserver_interface=127.9.142.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab
--principal=kudu/127.9.142.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.142.148:42647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.142.190:42533,127.9.142.189:45777,127.9.142.188:43445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:21:18.731189 16346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } attempt: 3
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
I20260811 07:21:18.738775 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.731617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:45777 (local address 127.0.0.1:46386)
0811 07:21:18.731683 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.731696 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:18.731773 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:18.731962 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:18.731964 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:18.732137 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:18.732215 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.732217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.732915 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.732917 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.733466 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.733467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.733950 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.733952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.734047 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.734533 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:18.734538 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:18.735964 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:18.737689 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.737690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.737691 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.737873 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.738087 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.738088 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.738088 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.738155 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.738422 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:18.738423 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:18.738473 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 07:21:18.738559 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 07:21:18.738670 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 07:21:18.738775 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.731686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46386 (local address 127.9.142.189:45777)
0811 07:21:18.731767 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.731769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.731782 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:21:18.731846 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.731847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.731866 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.731944 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.732304 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.732811 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.733597 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.733867 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.733926 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.736075 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.736077 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.736077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.736086 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.737578 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.737951 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.737952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.737952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.738017 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.738221 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.738222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.738223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.738344 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.738418 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.738587 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.738670 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 07:21:18.739167 16346 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:18.739876 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.739737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:48952)
0811 07:21:18.739809 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.739855 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 07:21:18.740226 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.740133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:48960)
0811 07:21:18.740179 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.740204 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 07:21:18.740320 16346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43445: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
I20260811 07:21:18.756877 16483 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } attempt: 1
I20260811 07:21:18.757406 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.757258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:48976)
0811 07:21:18.757328 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.757373 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 07:21:18.757910 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.757801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:48980)
0811 07:21:18.757850 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.757889 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 07:21:18.758175 16483 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43445: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
I20260811 07:21:18.771473 16346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } attempt: 1
I20260811 07:21:18.771986 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.771853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:48994)
0811 07:21:18.771914 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.771959 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 07:21:18.772416 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.772277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:49010)
0811 07:21:18.772342 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.772385 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 07:21:18.772583 16346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43445: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
W20260811 07:21:18.812983 16496 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:21:18.813489 16496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:21:18.813513 16496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:21:18.813563 16496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:21:18.815194 16496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:21:18.815237 16496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:21:18.815253 16496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:21:18.815264 16496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:21:18.815276 16496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:21:18.816901 16496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.142.148:42647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.142.190:42533,127.9.142.189:45777,127.9.142.188:43445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/krb5kdc/kudu_127.9.142.188.keytab
--principal=kudu/127.9.142.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.142.188:43445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.142.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:13:40 UTC on ccycloud.quasar-axwevi.root.comops.site
build id 4579821
I20260811 07:21:18.817171 16496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:21:18.817445 16496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:21:18.822393 16503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:18.822407 16504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:21:18.822409 16508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:21:18.822820 16496 server_base.cc:1034] running on GCE node
I20260811 07:21:18.823103 16496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:21:18.823414 16496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:21:18.824620 16496 hybrid_clock.cc:648] HybridClock initialized: now 1786432878824581 us; error 61 us; skew 500 ppm
I20260811 07:21:18.826339 16483 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } attempt: 2
I20260811 07:21:18.826804 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.826643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:49024)
0811 07:21:18.826722 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.826771 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:21:18.827206 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.827095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:49038)
0811 07:21:18.827146 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.827175 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 07:21:18.827347 16483 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43445: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
I20260811 07:21:18.827610 16496 init.cc:377] Logged in from keytab as kudu/127.9.142.188@KRBTEST.COM (short username kudu)
I20260811 07:21:18.828181 16496 webserver.cc:460] Webserver started at http://127.9.142.188:39373/ using document root <none> and password file <none>
I20260811 07:21:18.828476 16496 fs_manager.cc:359] Metadata directory not provided
I20260811 07:21:18.828527 16496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:21:18.828698 16496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:21:18.829890 16496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/data/instance:
uuid: "1155fdf3e22d431f9106f02e00cd7925"
format_stamp: "Formatted at 2026-08-11 07:21:18 on dist-test-slave-7f01"
server_key: "a5a91933ebc5ffbea41244d6035bba74"
server_key_iv: "10a10ebdb5c2d3701693e09efa030a0d"
server_key_version: "encryptionkey@0"
I20260811 07:21:18.830312 16496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/wal/instance:
uuid: "1155fdf3e22d431f9106f02e00cd7925"
format_stamp: "Formatted at 2026-08-11 07:21:18 on dist-test-slave-7f01"
server_key: "a5a91933ebc5ffbea41244d6035bba74"
server_key_iv: "10a10ebdb5c2d3701693e09efa030a0d"
server_key_version: "encryptionkey@0"
I20260811 07:21:18.831887 16496 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 07:21:18.832762 16522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:21:18.833108 16496 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:21:18.833201 16496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/data,/tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/wal
uuid: "1155fdf3e22d431f9106f02e00cd7925"
format_stamp: "Formatted at 2026-08-11 07:21:18 on dist-test-slave-7f01"
server_key: "a5a91933ebc5ffbea41244d6035bba74"
server_key_iv: "10a10ebdb5c2d3701693e09efa030a0d"
server_key_version: "encryptionkey@0"
I20260811 07:21:18.833259 16496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:21:18.847756 16346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } attempt: 2
I20260811 07:21:18.848282 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.848138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:49046)
0811 07:21:18.848206 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.848251 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 07:21:18.848773 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.848688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:49060)
0811 07:21:18.848730 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.848755 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 07:21:18.848909 16346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.142.188:43445: Network error: Client connection negotiation failed: client connection to 127.9.142.188:43445: connect: Connection refused (error 111)
I20260811 07:21:18.853615 16496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:21:18.856251 16496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:21:18.856382 16496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:21:18.860960 16496 rpc_server.cc:307] RPC server started. Bound to: 127.9.142.188:43445
I20260811 07:21:18.861032 16609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.142.188:43445 every 8 connection(s)
I20260811 07:21:18.861403 16496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/data/info.pb
I20260811 07:21:18.862563 16610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:21:18.864372 16610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:18.866978 9786 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNunSB7/build/release/bin/kudu as pid 16496
I20260811 07:21:18.867132 9786 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNunSB7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786432592145333-9786-0/minicluster-data/master-2/wal/instance
I20260811 07:21:18.867383 9786 external_mini_cluster.cc:1428] Setting key 8f833319c1efd5948e386efc2971905e
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:21:18.875339 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.865183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43422 (local address 127.9.142.190:42533)
0811 07:21:18.865260 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.865262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.865503 (+ 241us) server_negotiation.cc:407] Connection header received
0811 07:21:18.866022 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.866024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.866036 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.866101 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.866797 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.867398 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.868891 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.869188 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.869266 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.872187 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.872189 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.872189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.872197 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.873704 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.874127 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.874128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.874129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.874192 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.874667 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.874668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.874668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.874786 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.874871 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.875161 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.875246 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:21:18.875545 16612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.865153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.190:42533 (local address 127.0.0.1:43422)
0811 07:21:18.865369 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.865406 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:18.865907 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:18.866177 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:18.866181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:18.866448 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:18.866666 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.866670 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.867488 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.867489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.868798 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.868801 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.869303 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.869304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.869413 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.870000 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:18.870011 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:18.872085 (+ 2074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:18.873808 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.873816 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.873818 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.874048 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.874264 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.874265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.874265 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.874390 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.874877 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:18.874886 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:18.875025 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 07:21:18.875138 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 07:21:18.875294 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":107,"threads_started":1}
I20260811 07:21:18.876230 16610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:18.877328 16615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.867868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49066 (local address 127.9.142.188:43445)
0811 07:21:18.868085 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.868089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.868105 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:21:18.868165 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.868167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.868185 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.868257 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.869030 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.870053 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.871211 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.871513 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.871599 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.874198 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.874207 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.874208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.874215 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.875995 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.876381 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.876384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.876385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.876447 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.876674 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.876676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.876676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.876863 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.876980 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.877138 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.877227 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":115,"threads_started":1}
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.190@KRBTEST.COM
I20260811 07:21:18.885214 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.876859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46396 (local address 127.9.142.189:45777)
0811 07:21:18.877652 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.877659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.877667 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:21:18.877703 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.877703 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.877712 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.877755 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.878100 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.878735 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.879643 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.880039 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.880116 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.882021 (+ 1905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.882023 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.882023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.882030 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.883759 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.884283 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.884284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.884285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.884375 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.884603 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.884604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.884605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.884746 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.884795 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.885026 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.885110 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764}
I20260811 07:21:18.885614 16612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.876566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.189:45777 (local address 127.0.0.1:46396)
0811 07:21:18.876626 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.876637 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:18.876692 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:18.877795 (+ 1103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:18.877796 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:18.877967 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:18.878004 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.878007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.878800 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.878801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.879550 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.879553 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.880136 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.880138 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.880201 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.880589 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:18.880594 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:18.881905 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:18.883881 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.883882 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.883883 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.884170 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.884457 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.884459 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.884459 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.884528 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.884861 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:18.884862 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:18.884908 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:21:18.885415 (+ 507us) client_negotiation.cc:240] Negotiation successful
0811 07:21:18.885516 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 07:21:18.886128 16610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:21:18.888545 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.878707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43430 (local address 127.9.142.190:42533)
0811 07:21:18.879242 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.879244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.879253 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:21:18.879274 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.879274 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.879284 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.879338 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.879977 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.880682 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.881772 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.882087 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.882133 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.885553 (+ 3420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.885554 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.885555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.885562 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.887360 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.887705 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.887706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.887707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.887799 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.888021 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.888022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.888023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.888163 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.888332 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.888374 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.888454 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514}
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.188@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:21:18.894794 16612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.886654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:49080)
0811 07:21:18.886699 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.886710 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:18.886749 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:18.886906 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:18.886907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:18.887095 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:18.887135 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.887137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.888745 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.888746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.889507 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.889530 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.889999 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.890001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.890050 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.890473 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:18.890477 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:18.891611 (+ 1134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:18.893567 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.893568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.893568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.893831 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.894073 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.894074 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.894075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.894150 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.894466 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:18.894467 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:18.894502 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 07:21:18.894587 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:21:18.894686 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 07:21:18.895210 16615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.886712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49080 (local address 127.9.142.188:43445)
0811 07:21:18.886789 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.886792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.886802 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:21:18.886823 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.886824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.886835 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.886899 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.887219 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.887947 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.889610 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.889896 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.889976 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.891700 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.891701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.891702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.891708 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.893479 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.893904 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.893905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.893906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.893975 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.894232 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.894232 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.894233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.894393 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.894450 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.894610 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.894736 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":44}
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.142.189@KRBTEST.COM
I20260811 07:21:18.900382 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.889580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46404 (local address 127.9.142.189:45777)
0811 07:21:18.889631 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.889633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.889642 (+ 9us) server_negotiation.cc:407] Connection header received
0811 07:21:18.889662 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.889663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.889672 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.889723 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.890694 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.891412 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.893025 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.893344 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.893388 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.896700 (+ 3312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.896702 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.896702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.896710 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.899044 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.899407 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.899408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.899408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.899463 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.899679 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.899680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.899681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.899843 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.899996 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.900220 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.900299 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 07:21:18.901585 16610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925: Bootstrap starting.
I20260811 07:21:18.902674 16610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:18.902872 9786 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:21:18.903016 16610 log.cc:824] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:18.904487 16610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925: No bootstrap required, opened a new log
I20260811 07:21:18.904316 16304 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "54df265b68cd46ac900977b973c31433"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43430
I20260811 07:21:18.906582 16610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } }
I20260811 07:21:18.906745 16610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1155fdf3e22d431f9106f02e00cd7925, State: Initialized, Role: FOLLOWER
I20260811 07:21:18.906845 16610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } }
I20260811 07:21:18.907172 16610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:18.907156 16620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.907274 16620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:21:18.909220 16650 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:21:18.909281 16650 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:21:18.909456 16496 master_runner.cc:186] Error getting master registration for 127.9.142.190:42533: OK, instance_id { permanent_uuid: "54df265b68cd46ac900977b973c31433" instance_seqno: 1786432878502446 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:21:18.912770 16496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:21:18.918505 16483 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } attempt: 3
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.189@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:21:18.926222 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.918815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:49094)
0811 07:21:18.918877 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.918887 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:18.918929 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:18.919198 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:18.919200 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:18.919361 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:18.919407 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.919409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.920123 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.920125 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.921043 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.921045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.921423 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.921424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.921482 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.921964 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:18.921974 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:18.923355 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:18.925161 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.925162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.925162 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.925322 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.925560 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.925561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.925561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.925626 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.925922 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:18.925923 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:18.925965 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 07:21:18.926030 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 07:21:18.926125 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 07:21:18.926230 16615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.919019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49094 (local address 127.9.142.188:43445)
0811 07:21:18.919076 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.919078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.919085 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:21:18.919107 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.919108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.919116 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.919193 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.919485 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.920042 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.921150 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.921349 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.921422 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.923446 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.923448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.923448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.923455 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.925089 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.925394 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.925395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.925395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.925455 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.925686 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.925687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.925688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.925845 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.925914 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.926071 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.926148 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 07:21:18.928239 16483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744: Bootstrap starting.
I20260811 07:21:18.928972 16483 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:18.929291 16483 log.cc:824] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:18.930198 16483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744: No bootstrap required, opened a new log
I20260811 07:21:18.932245 16483 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } }
I20260811 07:21:18.932392 16483 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c2fd2cce21d4604a0ce67544221e744, State: Initialized, Role: FOLLOWER
I20260811 07:21:18.932471 16483 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } }
I20260811 07:21:18.932799 16483 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:18.932775 16656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.932874 16656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:21:18.934664 16671 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:21:18.934772 16671 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:21:18.934764 16370 master_runner.cc:186] Error getting master registration for 127.9.142.190:42533: OK, instance_id { permanent_uuid: "54df265b68cd46ac900977b973c31433" instance_seqno: 1786432878502446 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:21:18.937618 16370 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:21:18.948100 16346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } attempt: 3
Aug 11 07:21:18 dist-test-slave-7f01 krb5kdc[16219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786432878, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.142.190@KRBTEST.COM for kudu/127.9.142.188@KRBTEST.COM
I20260811 07:21:18.956234 16361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.948357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.142.188:43445 (local address 127.0.0.1:49100)
0811 07:21:18.948425 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 07:21:18.948439 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:21:18.948493 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:21:18.948680 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:21:18.948681 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:21:18.948859 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:21:18.948910 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.948912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.949837 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.949838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.950659 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:21:18.950661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.951109 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.951110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:21:18.951169 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.951620 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:21:18.951625 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:21:18.953145 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:21:18.954999 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.955000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.955000 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.955240 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.955469 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:21:18.955470 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:21:18.955470 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:21:18.955562 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:21:18.955892 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:21:18.955894 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:21:18.955961 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 07:21:18.956035 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 07:21:18.956131 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 07:21:18.956596 16615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.948477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49100 (local address 127.9.142.188:43445)
0811 07:21:18.948569 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.948571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.948578 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:21:18.948599 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.948600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.948609 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.948659 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.948993 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.949740 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.950741 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.951030 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.951098 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.953243 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.953244 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.953245 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.953252 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.954927 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.955321 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.955322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.955323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.955384 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.955629 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.955630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.955630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.955802 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.955889 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.956070 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.956233 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:21:18.958240 16346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433: Bootstrap starting.
I20260811 07:21:18.958986 16346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433: Neither blocks nor log segments found. Creating new log.
I20260811 07:21:18.959280 16346 log.cc:824] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433: Log is configured to *not* fsync() on all Append() calls
I20260811 07:21:18.960165 16346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433: No bootstrap required, opened a new log
I20260811 07:21:18.961545 16346 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } }
I20260811 07:21:18.961671 16346 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54df265b68cd46ac900977b973c31433, State: Initialized, Role: FOLLOWER
I20260811 07:21:18.961748 16346 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } }
I20260811 07:21:18.962052 16346 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:21:18.962193 16304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 07:21:18.962261 16304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:18.963039 16304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } }
I20260811 07:21:18.963546 16440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54df265b68cd46ac900977b973c31433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5c2fd2cce21d4604a0ce67544221e744"
I20260811 07:21:18.963671 16440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:18.962040 16678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.964442 16678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:18.964591 16440 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54df265b68cd46ac900977b973c31433 in term 1.
I20260811 07:21:18.964823 16264 leader_election.cc:302] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54df265b68cd46ac900977b973c31433, 5c2fd2cce21d4604a0ce67544221e744; no voters:
I20260811 07:21:18.964928 16678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:21:18.965104 16678 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [term 1 LEADER]: Becoming Leader. State: Replica: 54df265b68cd46ac900977b973c31433, State: Running, Role: LEADER
I20260811 07:21:18.965204 16678 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } }
I20260811 07:21:18.965605 16678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54df265b68cd46ac900977b973c31433. Latest consensus state: current_term: 1 leader_uuid: "54df265b68cd46ac900977b973c31433" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.965695 16678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:18.965636 16569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54df265b68cd46ac900977b973c31433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1155fdf3e22d431f9106f02e00cd7925"
I20260811 07:21:18.965749 16569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:21:18.965890 16704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:21:18.966321 16704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:21:18.966637 16569 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54df265b68cd46ac900977b973c31433 in term 1.
I20260811 07:21:18.966955 16304 leader_election.cc:288] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [CANDIDATE]: Term 1 election: Requested vote from peers 5c2fd2cce21d4604a0ce67544221e744 (127.9.142.189:45777), 1155fdf3e22d431f9106f02e00cd7925 (127.9.142.188:43445)
I20260811 07:21:18.968286 16569 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [term 1 FOLLOWER]: Refusing update from remote peer 54df265b68cd46ac900977b973c31433: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:21:18.968535 16678 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:21:18.968951 16440 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [term 1 FOLLOWER]: Refusing update from remote peer 54df265b68cd46ac900977b973c31433: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:21:18.969178 16678 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:21:18.969221 16239 master_runner.cc:263] No leader master found from master 54df265b68cd46ac900977b973c31433
I20260811 07:21:18.969323 16239 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:21:18.970317 16656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54df265b68cd46ac900977b973c31433. Latest consensus state: current_term: 1 leader_uuid: "54df265b68cd46ac900977b973c31433" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.970402 16656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:18.970328 16620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54df265b68cd46ac900977b973c31433. Latest consensus state: current_term: 1 leader_uuid: "54df265b68cd46ac900977b973c31433" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.970440 16620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:18.972311 16678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "54df265b68cd46ac900977b973c31433" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.972417 16678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:18.972704 16620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "54df265b68cd46ac900977b973c31433" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.972781 16620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:18.973524 16714 mvcc.cc:205] Tried to move back new op lower bound from 7317229072252002304 to 7317229072241942528. Current Snapshot: MvccSnapshot[applied={T|T < 7317229072252002304}]
I20260811 07:21:18.975803 16709 mvcc.cc:205] Tried to move back new op lower bound from 7317229072252002304 to 7317229072241942528. Current Snapshot: MvccSnapshot[applied={T|T < 7317229072252002304}]
I20260811 07:21:18.976198 16704 catalog_manager.cc:1347] Generated new cluster ID: 2c7c7cc5001943eeb80068e60f8cc05e
I20260811 07:21:18.976256 16704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:21:18.982964 16699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "54df265b68cd46ac900977b973c31433" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.983067 16699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433 [sys.catalog]: This master's current role is: LEADER
I20260811 07:21:18.983520 16656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "54df265b68cd46ac900977b973c31433" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54df265b68cd46ac900977b973c31433" member_type: VOTER last_known_addr { host: "127.9.142.190" port: 42533 } } peers { permanent_uuid: "5c2fd2cce21d4604a0ce67544221e744" member_type: VOTER last_known_addr { host: "127.9.142.189" port: 45777 } } peers { permanent_uuid: "1155fdf3e22d431f9106f02e00cd7925" member_type: VOTER last_known_addr { host: "127.9.142.188" port: 43445 } } }
I20260811 07:21:18.983603 16656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:21:18.983775 16715 mvcc.cc:205] Tried to move back new op lower bound from 7317229072252002304 to 7317229072241942528. Current Snapshot: MvccSnapshot[applied={T|T < 7317229072252002304}]
I20260811 07:21:18.984213 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.972110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43438 (local address 127.9.142.190:42533)
0811 07:21:18.972148 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.972150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.976003 (+ 3853us) server_negotiation.cc:407] Connection header received
0811 07:21:18.976094 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.976095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.976105 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.976135 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.977467 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.978178 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.979228 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.979533 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.979571 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.981137 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.981138 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.981139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.981146 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.982700 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.983189 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.983190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.983191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.983250 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.983469 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.983470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.983470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.983593 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.983678 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.984042 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.984122 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 07:21:18.987021 16615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.971772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49116 (local address 127.9.142.188:43445)
0811 07:21:18.971804 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.971806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.975918 (+ 4112us) server_negotiation.cc:407] Connection header received
0811 07:21:18.976029 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.976030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.976040 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.976072 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.977123 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.977833 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.978784 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.979074 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.979108 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.984317 (+ 5209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.984318 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.984319 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.984326 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.985891 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.986243 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.986244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.986245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.986294 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.986465 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.986466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.986466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.986580 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.986642 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.986852 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.986924 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 07:21:18.991317 16704 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:21:18.992017 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:18.972329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46412 (local address 127.9.142.189:45777)
0811 07:21:18.972383 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:18.972384 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:18.976276 (+ 3892us) server_negotiation.cc:407] Connection header received
0811 07:21:18.976377 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:18.976378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:18.976389 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:18.976417 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:18.979575 (+ 3158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.980270 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.983349 (+ 3079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:18.983634 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:18.983680 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:18.986582 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:21:18.986584 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:21:18.986584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:21:18.986592 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:21:18.988869 (+ 2277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.989492 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.989494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.989494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.989569 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:21:18.989783 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:21:18.989784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:21:18.989784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:21:18.989911 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:21:18.990010 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:18.991853 (+ 1843us) server_negotiation.cc:299] Negotiation successful
0811 07:21:18.991938 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 07:21:18.992079 16704 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:21:19.000339 16704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54df265b68cd46ac900977b973c31433: Generated new TSK 0
I20260811 07:21:19.000643 16704 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:21:19.029399 16364 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.027618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43446 (local address 127.9.142.190:42533)
0811 07:21:19.027662 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.027664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.028702 (+ 1038us) server_negotiation.cc:407] Connection header received
0811 07:21:19.028814 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.028816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.028828 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.028859 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.029311 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43446: BlockingRecv error: recv got EOF from 127.0.0.1:43446 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 07:21:19.030323 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.028075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46424 (local address 127.9.142.189:45777)
0811 07:21:19.028117 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.028119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.029829 (+ 1710us) server_negotiation.cc:407] Connection header received
0811 07:21:19.029928 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.029930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.029941 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.029970 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.030264 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46424: BlockingRecv error: recv got EOF from 127.0.0.1:46424 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 07:21:19.031167 16615 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.028441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49122 (local address 127.9.142.188:43445)
0811 07:21:19.028489 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.028492 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.030673 (+ 2181us) server_negotiation.cc:407] Connection header received
0811 07:21:19.030773 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.030775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.030786 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.030813 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.031107 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49122: BlockingRecv error: recv got EOF from 127.0.0.1:49122 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 07:21:19.033928 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.033051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46438 (local address 127.9.142.189:45777)
0811 07:21:19.033085 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.033087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.033357 (+ 270us) server_negotiation.cc:407] Connection header received
0811 07:21:19.033480 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.033482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.033499 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.033545 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.033889 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46438: BlockingRecv error: recv got EOF from 127.0.0.1:46438 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 07:21:19.037254 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.036421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46454 (local address 127.9.142.189:45777)
0811 07:21:19.036456 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.036457 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.036738 (+ 281us) server_negotiation.cc:407] Connection header received
0811 07:21:19.036839 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.036840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.036850 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.036879 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.037194 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46454: BlockingRecv error: recv got EOF from 127.0.0.1:46454 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 07:21:19.041203 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.040491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46460 (local address 127.9.142.189:45777)
0811 07:21:19.040523 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.040525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.040739 (+ 214us) server_negotiation.cc:407] Connection header received
0811 07:21:19.040828 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.040828 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.040837 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.040866 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.041163 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46460: BlockingRecv error: recv got EOF from 127.0.0.1:46460 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 07:21:19.047258 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.046483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46464 (local address 127.9.142.189:45777)
0811 07:21:19.046517 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.046518 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.046743 (+ 225us) server_negotiation.cc:407] Connection header received
0811 07:21:19.046862 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.046863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.046873 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.046903 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.047219 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46464: BlockingRecv error: recv got EOF from 127.0.0.1:46464 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 07:21:19.057384 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.056553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46466 (local address 127.9.142.189:45777)
0811 07:21:19.056589 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.056590 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.056835 (+ 245us) server_negotiation.cc:407] Connection header received
0811 07:21:19.056939 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.056939 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.056950 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.056979 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.057322 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46466: BlockingRecv error: recv got EOF from 127.0.0.1:46466 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 07:21:19.075878 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.074921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46476 (local address 127.9.142.189:45777)
0811 07:21:19.074964 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.074967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.075235 (+ 268us) server_negotiation.cc:407] Connection header received
0811 07:21:19.075346 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.075347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.075357 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.075401 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.075813 (+ 412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46476: BlockingRecv error: recv got EOF from 127.0.0.1:46476 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 07:21:19.110178 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.109380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46490 (local address 127.9.142.189:45777)
0811 07:21:19.109439 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.109441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.109542 (+ 101us) server_negotiation.cc:407] Connection header received
0811 07:21:19.109623 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.109624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.109633 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.109684 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.110092 (+ 408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46490: BlockingRecv error: recv got EOF from 127.0.0.1:46490 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 07:21:19.176136 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.175405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46502 (local address 127.9.142.189:45777)
0811 07:21:19.175488 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.175490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.175576 (+ 86us) server_negotiation.cc:407] Connection header received
0811 07:21:19.175626 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.175627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.175637 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.175704 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.176075 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46502: BlockingRecv error: recv got EOF from 127.0.0.1:46502 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 07:21:19.306229 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.305468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46510 (local address 127.9.142.189:45777)
0811 07:21:19.305565 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.305567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.305582 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:21:19.305662 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.305663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.305674 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.305727 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.306137 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46510: BlockingRecv error: recv got EOF from 127.0.0.1:46510 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 07:21:19.564302 16490 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:21:19.563503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46522 (local address 127.9.142.189:45777)
0811 07:21:19.563561 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:19.563563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:19.563610 (+ 47us) server_negotiation.cc:407] Connection header received
0811 07:21:19.563691 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:19.563692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:19.563703 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:19.563762 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:21:19.564232 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46522: BlockingRecv error: recv got EOF from 127.0.0.1:46522 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 07:21:19.909785 16650 catalog_manager.cc:1259] Loaded cluster ID: 2c7c7cc5001943eeb80068e60f8cc05e
I20260811 07:21:19.909906 16650 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925: loading cluster ID for follower catalog manager: success
I20260811 07:21:19.910735 16650 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925: acquiring CA information for follower catalog manager: success
I20260811 07:21:19.911055 16650 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1155fdf3e22d431f9106f02e00cd7925: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:21:19.935315 16671 catalog_manager.cc:1259] Loaded cluster ID: 2c7c7cc5001943eeb80068e60f8cc05e
I20260811 07:21:19.935446 16671 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744: loading cluster ID for follower catalog manager: success
I20260811 07:21:19.936409 16671 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744: acquiring CA information for follower catalog manager: success
I20260811 07:21:19.936789 16671 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5c2fd2cce21d4604a0ce67544221e744: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:21:20.080003 16843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:20.077517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46532 (local address 127.9.142.189:45777)
0811 07:21:20.077642 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:20.077644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:20.077655 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:21:20.077740 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:20.077741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:20.077796 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:20.077891 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:20.078017 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.078517 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.079243 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.079429 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.079479 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:20.079637 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:20.079763 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:20.079821 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:20.079839 (+ 18us) server_negotiation.cc:299] Negotiation successful
0811 07:21:20.079857 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
I20260811 07:21:20.084486 16850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:20.082084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49134 (local address 127.9.142.188:43445)
0811 07:21:20.082209 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:20.082211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:20.082218 (+ 7us) server_negotiation.cc:407] Connection header received
0811 07:21:20.082257 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:20.082258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:20.082294 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:20.082363 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:20.082454 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.082946 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.083691 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.083987 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.084050 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:20.084186 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:20.084293 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:20.084346 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:20.084397 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 07:21:20.084419 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":75,"threads_started":1}
I20260811 07:21:20.089123 16850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:20.086407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49140 (local address 127.9.142.188:43445)
0811 07:21:20.086453 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:20.086455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:20.086463 (+ 8us) server_negotiation.cc:407] Connection header received
0811 07:21:20.086506 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:20.086507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:20.086519 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:20.086573 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:20.086695 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.087441 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.088287 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.088563 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.088622 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:20.088812 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:20.088845 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:20.088897 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:20.089002 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 07:21:20.089026 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 07:21:20.089435 16843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:20.086187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46544 (local address 127.9.142.189:45777)
0811 07:21:20.086288 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:20.086290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:20.086742 (+ 452us) server_negotiation.cc:407] Connection header received
0811 07:21:20.086821 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:20.086822 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:20.086831 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:20.086883 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:20.086990 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.087679 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.088619 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.088887 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.088957 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:20.089109 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:20.089143 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:20.089193 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:20.089337 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 07:21:20.089359 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:21:20.089488 16862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:21:20.086189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43452 (local address 127.9.142.190:42533)
0811 07:21:20.086341 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:21:20.086343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 07:21:20.086408 (+ 65us) server_negotiation.cc:407] Connection header received
0811 07:21:20.086456 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:21:20.086457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:21:20.086513 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:21:20.086596 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:21:20.086753 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.087342 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.088352 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:21:20.088665 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:21:20.088722 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:21:20.088919 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:21:20.089148 (+ 229us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:21:20.089206 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:21:20.089365 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 07:21:20.089389 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":59,"threads_started":1}
I20260811 07:21:20.091277 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 16239
I20260811 07:21:20.104521 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 16370
I20260811 07:21:20.117574 9786 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNunSB7/build/release/bin/kudu with pid 16496
2026-08-11T07:21:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3153 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6436 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (287987 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST